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ABSTRACT 

This report concerns the use of benchmarking as a 
strategy for assessing and improving efficiency and productivity of 
administrative processes and instructional models in colleges and 
universities. The introductory chapter addresses the need for new 
tools and strategies to meet the increased competition and the higher 
demand for accountability faced by institutions of higher education 
and the development of benchmarking by the Xerox Corporation in the 
1980s. The second chapter presents various definitions of 
benchmarking, an ongoing, systematic process for measuring and 
comparing the work processes of different organizations by bringing 
an external focus to internal activities and functions. An overview 
of benchmarking identifies a four-step benchmarking process model 
that includes (1) planning the study, (2) conducting the research, 

(3) analyzing the data, and (4) adapting the findings to the home 
institution. Four kinds of benchmarking are identified and discussed: 
internal, competitive, functional/industry, and generic. The third 
chapter reviews the current uses of benchmarking in higher education, 
as undertaken by such organizations as the National Association of 
College and University Business Offices; the Association for 
Continuing Higher Education, the Graduate Management Admission 
Council/Educational Benchmarking, Inc., and independent institutions. 
The final chapter gives detailed recommendations and outlines a 
procedure for institutions interested in undertaking a benchmarking 
study. (Contains approximately 115 references.) (PRW) 
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l~ EXECUTIVE SUMMARY 

Increasing competition, demands tor accountability, and 
higher volumes of available information are changing the 
methods of how institutions of higher education operate in 
the mid-1990s. For higher education to enact substantial 
and sustainable changes in efficiency and productivity, a 
new way of thinking, or paradigm, that builds efficiency and 
a desire for continual learning must be integrated into insti- 
tutional structures. 'Idols are also being developed that 
measure, or benchmark, the progress and success ol these 
efforts (Keeton & Mayo-Wells 199-i ). Among the improve- 
ment strategies and techniques such as Total Quality 
Management (TQM). Continuous Quality Improvement 
(CQI ). and Business Process Reengineering (BPK). bench- 
marking has emerged ns a useful, easily understood, and 
effective too! for slaying competitive. 

What Is Benchmarking? 

Although the use of comparative data has been used for 
years in some industries, including higher education, bench- 
marking. as defined today, was developed in the early 1980s 
at the Xerox Corporation in response to increased competi- 
tion and a rapidly declining market share (Camp 1989). The 
strategy of benchmarking is important both conceptually and 
practically. It is being used for improving administrative 
processes as well as instructional models at colleges and 
universities, bv examining processes and models at other 
schools and adapting their techniques and approaches 
(Chaffee Sherr 1992; Clark 1995). More concisely, bench- 
marking is an ongoing, systematic process tor measuring 
and comparing the work processes of one organization to 
those of another, by bringing an external locus to internal 
activ ities, functions, or operations ( Kempner 1995). The 
goal of benchmarking is to provide key personnel, in charge 
of processes, with an external standard for measuring the 
quality and cost of internal activities, and to help identify 
where opportunities tor improvement may reside, 
benchmarking is analogous to the human learning process, 
and it has been described as a method ol teaching an insti- 
tution how to improve (Lcibfried McNair 1992). As with 
other quality concepts, benchmarking should be integrated 
into the fundamental operations throughout the organization 
and he an ongoing process that analyzes the data collected 
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longitudinally. Benchmarking attempts to answer the fol- 
lowing questions: 

• How well are we doing compared to others? 

• 1 low good do we want to he? 

• W ho is doing it the best? 

• How do they do it? 

• How can we adapt what they do to our institution? 

• How can we he better than the best? (Kempner 1993) 

Previously, questions like these may not have seemed 
important to institutions of higher education. How ever, in 
the competitive and rapidly changing markets of the 1990s 
(characterized by declining enrollments and funding in high- 
er education), organizations are learning never to be satis- 
fied with the status-quo. and to continually question their 
internal operations and relative position in the eyes of 
prospective customers. To answer these questions, several 
multi-step benchmarking methods have been developed by 
leading benchmarking practitioners (Camp 199^: Spendolini 
1992: Watson 1992). Benchmarking procedures can be con- 
densed into lour steps: planning the study, conducting the 
research, analyzing the data, and adapting the findings to 
the home institution that is conducting the study. The first 
step involves selecting and defining the administrative or 
teaching process! es) to be studied, identifying how the 
process will be measured, and deciding which other institu- 
tions to measure against. Second, benchmarking process 
data is collected using primary and or secondary research 
about the colleges, universities, or other organizations being 
studied. The third step consists of analyzing the data gath- 
ered to calculate the research findings and to develop rec- 
ommendations. At this point, the differences oi gaps in 
performance between the institutions being benchmarked 
help to identify the process enablers that equip the leaders 
in their high performance. Adaption of these enablers for 
improv ement is the fourth step in the first iteration of a 
benchmarking cycle, and the primary goal of the project. 

A rev iew of the benchmarking literature shows that there 
are primarily four kinds of benchmarking: internal, competi- 
tive. functional industry, and generic or best-in-class. 

Internal benchmarking can be* conducted at large, decentral- 
ized institutions where there are several departments or 



units that conduct similar processes. The more common 
competitive benchmarking analyzes processes with peer 
institutions that are competing in similar markets. 

Functional or industry benchmarking is similar to competi- 
tive benchmarking, except that the group of competitors is 
larger and more broadly defined (Rush 199-0. Generic or 
best -in -class uses the broadest application of data collection 
from different industries to find the best operations practices 
available. 1'he selection of the benchmarking type depends 
on the process(es) being analyzed, the availability of data, 
and the available expertise at the institution. 

Is Benchmarking Applicable to Higher Education? 

Due to its reliance on hard data and research methodology, 
benchmarking is especially suited to; institutions ol higher 
education in which these types of studies are very familiar to 
faculty and administrators. Practitioners at colleges and 
universities have found that benchmarking helps overcome 
resistance to change, provides a .structure tor external evalu- 
ation. and creates new networks ot communication between 
schools w here valuable information and experiences can be 
shared <AAC.SH IWt). benchmarking is a positive process, 
and provides objective measurements for baselining (setting 
the initial values), goal-setting, and improvement tracking, 
which can lead to dramatic innovations (Shafer & Coate 
1992). In addition, quality strategies and reengineering 
efforts are both enhanced by benchmarking because it can 
identify areas that could benefit most from TQM and or 
BPR. and make it possible to improve operations with often 
dramatic innovations. 

Despite the majority of positive recommendations for 
using benchmarking and successful examples ol its current 
use. there are critics of its applicability to higher education. 
The stated objections include the belief that benchmarking is 
merely a strategy for marginally improving existing process- 
es. is applicable only to administrative processes (or only to 
teaching practices), is a euphemism for copying, is lacking 
innovation, or that it can expose institutional weaknesses 
(Brigham 199s; Dale 1995). These concerns are largely 
unfounded because benchmarking can radically change 
processes (if warranted), apply to both administration and 
teaching, adapt — not 'adopt" — best practices, and it the 
benchmarking (.ode ol Conduct is followed, confidentiality 
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corn erns can ho reduced. The Code ot Conduct calls for 
benchmarking prac titioners to abide by stated principles of 
legality, exchange, and confidentiality (APQC 1993). 
Benchmarking can make it possible for the industry to 
improve processes in a "leapfrog" fashion by identifying and 
bringing home best practices, and therefore offering a way 
of responding to demands for cost containment and 
enhanced service quality in a cost-effectiv e and quality- 
oriented manner (APQC 1993: Shafer & Coate 1992). 

Where Is Benchmarking Being Used in Higher 
Education? 

Graduate business schools, professional associations such as 
XACUBO and ACME, independent data sharing consortia, 
private consulting companies, and individual institutions are 
all conducting benchmarking projects. The broad-based 
\ ACT BO benchmarking program was begun in late 1991. 
and it seeks to provide participants with an objective basis 
tor improved operational performance by offering a "point- 
er" to the best practices of other organizations. Today, near- 
ly 2S2 institutions have participated in the study, and the 
current project analyzes 2(> core functions at colleges and 
universities, such as accounting, admissions, development, 
payroll, purchasing, student housing, and others (XACl’BO 
1993). The Association for Continuing Higher Education 
(ACT IE) and graduate business schools have also conducted 
specialized benchmarking studies that focus on the process- 
es and practices concerning their particular institutional 
departments (AACSB 199 t: Alstete 199(>). A review of the 
literature finds independent benchmarking projects are cur- 
rently in use. or have recently been conducted, by a wide 
range of institutions, such as the University of Chicago. 
Oregon State University. Pennsylvania State University. 
Babson College, and many others. These independent proj- 
ects cover undergraduate and graduate teaching processes, 
as well as academic and business administrative practices. 

How Can an Institution Get Started? 

Before beginning a benchmarking study, an institution 
should decide if benchmarking is the correct quality 
improvement tool for the situation. After processes are 
selected for analvsjs. the appropriate personnel, who have a 
working knowledge of the area undergoing the bcnchmark- 
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ing analysis, should then bo chosen to conduct the study. A 
college and university can take part in an externally spon- 
sored benchmarking project with predefined objectives, or 
conduct a project on its own. or with the help of consult- 
ants. It is recommended that, as a start, an institution new 
to benchmarking, begin with a more “grassroots" level 
departmental or administrative project that measures best 
practices internally, or with local competitors. An institution 
that is more advanced in quality improv ement efforts can 
seek out world-class competitors better and implement the 
findings more readily than a benchmarking novice 
(Marchese 1995b). Information on prospective benchmark- 
ing partners can be obtained from libraries, professional 
associations, personal contacts, and data sharing consortia. 
Once the benchmarking data is collected and analyzed, it 
can be distributed in a benchmarking report internally with- 
in the institution and externally to benchmarking partners 
for implementation of improved processes. The overall goal 
is the adaption of the process enablers at the home institu- 
tion to achieve effective quality improvement, bench- 
marking is more than just gathering data. It involves 
adapting a new approach of continually questioning how 
processes are performed, seeking out best practices, and 
implementing new models of operation. 
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FOREWORD 




In many different ways. American higher education has 
been practicing benchmarking almost from the start. 

Harvard and the early colonial colleges were an adaptation 
of the Knglish undergraduate colleges. They were an adap- 
tation in the respect that they were not a carbon copy of the 
Knglish model since the colonial colleges adjusted their cur- 
riculum. organization, and financing to meet the unique 
needs of early American life. When Johns Hopkins 
I'niversity was established, modeled on the German univer- 
sity. it quickly made several fundamental changes, including 
adding an Knglish model undergraduate program. Later on. 
as new colleges were being established in the early 1800 s in 
the Midwest, they benchmarked themselves against more 
established American colleges. A common refrain was that 
"this college will be the Harvard of...." 

The essence el modeling oneself against certain standards 
or processes in order to produce a desired result is what 
benchmarking is all about. There are a number of condi- 
tions in operation today that make the process of bench- 
marking not only acceptable but almost mandatory for 
higher education. First, because of the sophistication ol 
consumers (students, parents, employers) and sponsors 
(state legislators and private sponsors) ol higher education, 
institutions are being held to a higher standard of perform- 
ance. Second, not only is the knowledge base of many 
areas in higher education changing rapidly, awareness con- 
cerning these changes is so widespread that the stakeholders 
of higher education are increasingly dissatisfied with the 
status quo. Third, the legitimacy of new ideas based on its 
origin — our institution is so unique that il an idea was not 
developed by one of us. it could not possibly be useful — is 
giving way to the legitimacy based on results. If we can get 
our results more effectively by doing it a different way. we 
should change. A fourth condition, possibly a result ol the 
other three, is a realization that through benchmarking, not 
only can time, energy, and money be saved, an institution 
can also maintain a continuous competitive edge and 
enhance dieir national reputation. 

Generally speaking, benchmarking is the process of iden- 
tifying someone or some organization that is doing some- 
thing better than you are doing, studying how thev are 
doing il. and adapting those procedures that would be most 
usef ul to reach your desired outcome, benchmarking can 
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he used to evaluate and improve specific practices (such as 
developing active learning in the classroom, creating more 
effective slide presentations, or designing a more under- 
standable tuition and fee invoice form): better processes 
(establishing better ways io advise students on their academ- 
ic piograms or more effective ways to handle student appli- 
cations); or systems, (e.g.. increasing more effective use of 
courses over several academic programs); or creating a man- 
agement enrollment system that works with students from 
the first contact through graduation. While benchmarking 
can be used successfully for any of these purposes, the 
greatest impact on the institution is the benchmarking of 
systems. 

In this report by Jeffrey \Y. Alstete. associate dean in the 
Hagan School of Business at Iona College, the concept and 
process of benchmarking is examined with four forms of 
benchmarking being highlighted — internal, competitive, 
functional, and generic. Or. Alstete details the specific steps 
that an institution needs to take in order to implement the 
benchmarking process and gives examples of benc hmarking 
projects that institutions could follow. 

Benchmarking in the future mav not be optional. 
Increasingly, institutions are being asked to give specific 
evidence concerning the value of their outcomes as com- 
pared with other institutions. When benchmarking is care- 
fully used to help institutions improve their processes and 
systems in order to better achieve their educational mission, 
institutions are equipped to defend against external goals 
and standards that could be dysfunctional and even destruc- 
tive to an institution. This report will help institutions begin 
developing a benchmarking process that will help them to 
become more proactive in setting standards for their future. 

Jonathan D. Fife 

Series Bditor. 

Professor of Higher Kduealion Administration and 
Director. BRIC Clearinghouse on Higher Education 
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OTHER PART OF THE “NEW PARADIGM 1 



.aurence Veysey. in w riting about the history ol great 
•lunges that occurred in higher education during the latter 
part oi the I9lh century, stated that the American university 
of 1900 was all hut unrecognizable in comparison with the 
‘ol lege of hShi) (Yevsey 190s). Philosophically, intellectual- 
y. and functionally, higher education had changed due to 
the changing needs of society. The next great period ol 
change began alter the Second World War. when the Ci.l. 
bill of Rights made a college education more accessible to 
art increasingly egalitarian society, and fueled a tremendous 
growth in demand lor higher education (breed in 199 1 ). As 
we examine institutions ol higher education today, many 
people believe that we are at a comparable turning point or 
period of transition (Apps I9K8: Hover 1990). Future histori- 
ans may record this transitional period as comparable to the 
changes that occurred in the 1 late IKOUs or from the 19s0s to 
the I9"0s. The change’s that are shaping the future ol higher 
education are due to many factors, including competition 
dx'iween colleges and universities and with other providers, 
new information technology, changes in student 
enrollments, financial and economic conditions, and chang- 
ing societal demands. In the past, most institutions ol high- 
er education, which have adapted to the changing limes, 
have learned new methods ol operations in-order to survive. 

Colleges and universities are places in which learning is 
the main activity for students, faculty, and the administra- 
tion. Personnel in higher education can be viewed as devel- 
opers. brokers, and users ('1 information, who strive to 
obtain and transmit the best data possible. Ov er the last two 
decades, credible authors have claimed that society is min- 
ing from an industrial age to an informational age. Vast 
amounts of information, and our access to it. will change 
nearly everything, especially the wav learning takes place 
(Hell 19“3: Naisbitt 1982: Tofilcr 1980). Higher education is 
a major source of new information through the research 
conducted and through the primary method of distribution 
— its instructional programs. However, processing tremen- 
dous volumes of information has its problems, as well as 
rewards. The book titled the (.'omini* of l*ost-hnlnstrial 
Society accurately predicted many ol the current problems 
2,^ vears later. Hell ( 1 9~ A ) stated: 



In the past , 
most 

institutions of 
higher 
education, 
which have 
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changing times, 
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The host-industrial society is an information society, as 
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industrial society is a goods-producing society. 

I loit erer. (be centrality of in formation creates some 
new. and different problems for society to manage. 

These are: 

1 . The sheer amount of information that one has to absorb 
because of the ex/ x a is ion of (he different arenas — eco- 
nomic. political, and social — of men's attention and 
iurolremenf . . . 

2. The information becomes more technical . . . 

. >. There is a greater need for mediation, or journalistic 
translation . . . that explain the new theories to intermedi- 
ate and mass audiences . . . 

/. The sheer limits if the amount of information one can 
absorb . . . 

s. /Heritably a complex society, like the large, complex orga- 
nizations within it. becomes a planning society ( pp. i(f- 
rm. 

The goal of this report is to address lhe.se problems, fore- 
tasted m > accurately by bell as they relate to the data and 
systems comparisons techniques, referred to as benchmark- 
ing. that are used by institutions of higher education to pro- 
vide information for quality improvement. It is difficult 
todav to read an academic magazine, newspaper, or educa- 
tion journal without coming upon an example of one of the 
mam quality improv ement methods suc h as Total Quality 
Management <TQM) or Continuous Quality Improvement 
<CQI>. business Process Reengineering (bPR). benchmark- 
ing. and others. These tools and the information they pro- 
vide 1 seem increasingly technical, and often use language that 
is unfamiliar to some readers. It is therefore appreciated, 
and often required, that a "mediation” or "translation” (bell 
IfTC be written to help those in a specific field, such as 
higher education, to understand more thoroughly and possi- 
bly to utilize this new. complicated, technical information. 

Among other things, this information is needed for plan- 
ning. f or managers in business and industry, as well as for 
college administrators and faculty, planning is probablv the 
most important function. I'nfortunatcly. much of the litera- 
ture on planning is normative and consists primarily of how 
planning 'should be done." rather than describing how plan- 
ning “is done (Sink X Caflarclla IbUtn. t hese writings are 
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often accompanied by elaborate reasons as to why the plan- 
ning method should be used, but are usually lacking good 
examples of how it is being used effectively in organiza- 
tions. This report will describe the benchmarking process, 
discuss examples of its use in higher education, and show 
how it can be used in successful planning for process 
improvement by the reader. 

New Demands on Higher Education 

Business corporations and the post-secondary educational 
community are both experiencing new demands emanating 
from the changing needs of society. Greater competition, 
reduced public funding, and possible financial disaster are 
now situations that many institutions of higher education are 
trying to avert as the enrollment boom from the 19(>0s to the 
1980s subsides in the 1990s (('lotfelter. Khrenberg. Get/. & 
Siegfried 1991). Administrators and faculty must now 
address budget gaps caused by the changing demands, con- 
stricting resources, national and regional recessions, and the 
basic questions about the value of higher education to 
prospective students. In addition, while the earnings bonus 
attached to obtaining a college education has continued to 
show improv ements over time, it is difficult to forecast with 
confidence what the returns on investments in higher educa- 
tion will be in the near future. These (actors have had a 
combined impact on the financial health of many colleges 
and universities. When faced with reduced revenues, most 
colleges and universities have responded by tightening bud- 
gets. deferring non-recurring expenses, and postponing the 
hiring of new faculty and staff (Zemsky & Massy 1995). 

Some institutions and campuses were unable to slay finan- 
cially competitive, such as I'psala College in New Jersey and 
Iona College’s campus in Yonkers. New York, and have 
recently closed (Aronow 199.5; Martin 1995). 

Higher education providers are now learning that they, 
too. must be responsive to their environment to survive, 
because both the number and extensiv eness of env ironmen- 
tal forces have increased greatly in recent years (Birnbaum 
1988). Both the administration and faculty feel unable to 
take control as resources are constrained. Often, the result 
is more commitment and effort to keep organizational 
processes, services, and goals the same, or to support the 
status quo. Benchmarking has been introduced as one 
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method or tool to help create a new way of thinking, or 
paradigm." for higher education to make a substantial and 
sustainable change in efficiency (Keeton & Mayo-Wells 
199 1 ). As changes in efficiency are built into the basic struc- 
tures and tunctioning of colleges and universities, bench- 
marking can be used to seek out best practices and monitor 
the progress and success of the changes. For example, an 
associate dean at Arizona State I'niversity (ASl) stated. "We 
say that we want to look like a leading MBA program. |This| 
requires that we know what leading MBA programs look 
like" (Wolvcrion 199 i. p.36). To achieve this goal. ASl" s 
business school benchmarks information on entry standards, 
curriculum content, faculty credentials and salaries, place- 
ment. and starting salaries for MBA program graduates. 

Clark ( 1993 ) added, "I 'niversity students are older, wiser, 
and more determined than ever to receiv e a meaningful 
education, and at the same time, improve the quality of life" 
(p. 2). Clark proposed using benchmarking to help satisfy 
these student demands by restructuring higher education, 
w ithout sacrific ing the special characteristics that makes each 
college and university unique. For these reasons, and others 
discussed later in this report, benchmarking is fast becoming 
an important quality improvement tool. Benchmarking was 
recently discussed at several academic conferences, includ- 
ing the National Conference on Continuous Quality 
Improvement Reutter 1993). the American Assembly of 
Collegiate Schools of Business (Bateman 199 t). and the 
Association for Institutional Research (AIR 199-0. Because 
today’s students are more demanding, and lend to "shop" 
competitively, benchmarking enables colleges and universi- 
ties to improve by comparing performance (both administra- 
tively and academically) with comparable or peer 
institutions, "best-in-class." and even world-class organiza- 
tions outside of higher education. In educational testing, for 
example, this might mean comparing student performance, 
not against local norms, but against a higher set of interna- 
tional standards ( Marchcse 1991). Benchmarking provides 
v aluable information and hard data, which is needed by 
colleges and universities to measure productivity. George 
Keller ( 19H.M stated that "competition has not been absent 
from American higher education in the past eenturv . . . But 
(ompetiiion among col'eges has begun to intensify and will 
increase significantly in the period ahead, requiring new 



campus modes of operation and new surveillance proce- 
dures' - (pp. 16-1“'). Keller accurately predicted thal the 
competition is not only for students, but for other resources 
as well. 

Robert Birnbaum 1 1992). in researching the constraints on 
productivity in higher education, conducted extensive inter- 
views \v itli "0 trustees, administrators, and faculty leaders at 
seven div erse institutions of varying size and classification. 

He found tliat one of the primary rational constraints on 
product iv it\' improvement is the lack of availability for data 
related to productivity (Birnbaum 1992). Large financial 
resources weie thought to be required for obtaining ade- 
quate data, and the history and traditions of the institutions 
did not support data-related decision-making. Some of the 
new management improvement techniques, such as bench- 
marking. are designed to address these problems by making 
the data available at a reasonable price, and by providing 
the techniques for carrying out improvements in tradition- 
bound organizations, such as colleges and universities. 

Contemporary Management Strategies 

In the 1980s, public concern for quality in education, pri- 
marily for the elementary and secondary schools, w as 
brought to national attention in the report. A Xation at Risk'. 
The Impcmtiivfor Educational Reform ( National 
Commission for Hxcellence in Hducation 19X.M. 'I his report 
stated manv concerns for education, including the belief that 
the increased rate of competition and changing conditions of 
the workplace require the need for a learning society. Later 
in that decade, and more strongly in the 1990s, the post- 
sccondarv level also became the focus of quality improv e- 
ment. TQM. BRR. CQI, downsizing, outsourcing, and other 
contemporary management strategies have recently become 
commonplace on college and university campuses (Nieklin 
199s). A variety of publications on the quality movement in 
higher education have all examined these programs in high- 
er education: recent books (AAIIK 199 I; Seymour 199 lb: 
Seymour 1992); journal articles ( Hobbs 199 i; Stein 199s). 
newspaper articles (Nieklin 199s); conferences (Rentier 
199s). as well as recent ASHK-RRIC Reports (Chaffee <N Slicrr 
1992: Gardiner 199 t: Wolvcrton 199 i ). The complete litera- 
ture on the call for improvement of management processes 
in higher education is too extensive to list here, and it con- 
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tinues to grow . Some of the literature ; elates concerns 
about the appropriateness of quality strategies in higher 
education, but the vast majority are positive. A search of the 
business periodical index for the past five years ( 1990-1995) 
found 'hat the terms “TQM" and “benchmarking" are quite 
popular among business researchers (see Figure l). The 
same search of the FR1C national education literature data- 
base also found that these quality principles are becoming 
more widely used and referred to by education researchers 
and authors as well (see Figure 2). This data does not nec- 



FIGURE 1 — Business Periodical Index Search Results 
tor ‘‘TQM” and “Benchmarking” 




FIGURE 2 — Education Research Index Search for “TQM” 
and “Benchmarking” 
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essarily mean that hem hmarking is being used more than 
TQM by colleges and universities, but its popularity trend is 
quite ev ident. The comparison betw een benchmarking and 
TQM show s that the use of competitiv e data to measure 
effectiveness, set goals, and improve processes (benchmark- 
ing) is somewhat in sequence with the more widely publi- 
cized TQM. Interestingly. TQM seems to have peaked in 
1993 for both business and education periodicals, while 
benchmarking may have peaked in 199-t literature. In addi- 
tion. other topics such as assessment (Reimdnn 199s; 

Wat wood 1993 ). productivity (IJlumensiyk 1993; Heverly it 
Conneskv 1992) and performance indicators (Gaither. 

Nedwck «S: Neal 199 t). all point toward a demand for greater 
efficiencv and public accountability in the 1990s. Alstete 
( 199a) and Gaither ( 1993) add that information technology is 
also helping the creation and use of these management tech- 
niques for monitoring performance and quality. 

Additional evidence that the use of other quality improve- 
ment strategies may be increasing is that a recent rev iew ol 
10 Boston-area colleges, vvhch started using TQM. found 
that five are no longer r-. s. ing it (Hntin 199 t). For the 
remaining institutions, the use ol TQM resulted in many 
quality improv ements. 

Generally, quality efforts result in a greater customer 
focus, aw areness of process, and new questions about out- 
comes and data, all of w hich can be taken as favorable 
developments for an organization. Hntin ( 199 t) stated that 
greater student-centeredness can happen on both the admin- 
istrative and academic sides of colleges and univ ersities. 
Despite higher education historian Frederick Rudolph's 
( 19 ) belief that college faculty are "suspicious of efficiency 

and expert at obstruction" tp. -t). administrators are not the 
only personnel that seek to improve the quality of higher 
education. Many, if not most, of the professorate also sup- 
port the reform movement, and have stated that they have 
no quarrel with the need for changes (Bowen «S; Schuster 
19S0). The faculty not only fulfills the main functions of 
research, teaching, and service at colleges and universities, 
but thev are often the first to receiv e student comments on 
the incidental and overall efficiencies of the institution. 
Chapter three of this report w ill show how benchmarking is 
used In both faculty and administration in higher education. 

There are both votal critics and strong proponents of 
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these efforts. Critics >uch as George Keller have slated that 
these projects have not been successful because “colleges 
and universities are ambiguous about who the customers 
are: students, professors, taxpayers, parents, or graduates” 
prospective employers” (Nicklin 199^. p. A33). in addition, 
some argue that colleges are using terms such as "reengi- 
neering” or "restructuring” merely as a public relations ploy 
to cover harsh cost-cutting and employee layoffs. Perhaps 
the most common complaint is that many people emploved 
in higher education sincerely believ e that colleges and uni- 
versities are diflerent trom business corporations. Some 
institutions hav e responded by moderating the use of busi- 
ness terms and replacing them with more culturally sensitive 
terms, such as "committees" instead of "teams." or "indica- 
tors" instead of "measures" (Gaither el al. 199 1). 

However, the proponents of quality and related efforts for 
higher education are many, and often, they stridently stated 
that it can work here. too. Sherr and l.oxicr ( 1991 ) w rote: 

If volt think that these ideas make sense /hr industry, 
hut that higher education is different, he assured that 
many coiporate leaders hare responded in like fashion: 
"But ire are different . " Higher education is different, 
and our conserratireuess does make it difficult. But 
consider the rallies that TQM espouses . . . Importance 
of people . . . Seed to l se Knowledge . . . Continuous 
Impnnvmeut . . . We in higher education hold dearly 
such rallies . . (p. It)). 

These sentiments are echoed by others, including lieverly 
and Gorncsky ( 1992) who slated that “TQM offers a philoso- 
phy that drives everyone in the organization to use data, and 
it provides methods and tools for achieving this purpose" (p. 
1 13). One of the tools referred to here is benchmarking, 
which we shall see is only one part of an overall quality 
improv ement eflort al a successful organization. 

In reviewing the efforts of higher education and its use of 
TQM and restructuring strategies. Rhoades ( 1993) stated that 
these efforts often build on existing organizational structures 
and on past patterns of production and resource allocation. 

1 le added: 

The preeminent danger is that the future of our institu- 






lions trill hr compromised if ire simply seek continuity 
irith (Hist structures: fail to restructure, rethink, and 
change substantially on r production processes, and do 
not reallocate our work efforts to reposition oursehvs in 
relation to other higher education institutions, gain 
public support, atid increase our productivity, 
resources, and quality (p. 29). 

One institution that has been a pioneer in applying total 
quality management. Business Process Reengineering, and 
benchmarking is Oregon State University (Shafer & Coate 
1992). OSr began implementing total quality management 
in 1989. and shortly thereafter achieved some process 
improvement, elimination of waste in time and materials, and 
cost reductions. However, in 1991. a quicker response was 
demanded by the Oregon State Legislature for improved 
administrative costs and support services. Benchmarking was 
used as a key instrument, along with TQM and Reengineer- 
ing. to ensure that improvement initiatives locus on areas 
with potential for enhancement. Further, it is described in 
Chapter Three how OSU used benchmarking as a continuous 
process to measure its sen ices against the competition. 

Benchmarking Benefits 

Benchmarking may find more of a home in higher education 
than the other recently adapted management improvement 
techniques, due to its reliance on research methodology and 
hard data. Broadly, benchmarking is defined as "a continu- 
ous. systematic process for evaluating the products, services, 
and work processes of organizations that are recognized as 
representing best practices for the purpose of organizational 
improvement" (Spendolini 1992. p. 9k The process in this 
definition involves conducting research on competing and 
noncompeting organizations which are leaders in certain 
areas. .Many of the research techniques used here are very 
familiar to the academic community — primary and 
secondary research, mail-out surwys. interviews, and oth- 
ers — are used for data collection and analyses. In addition, 
benchmarking does not rely on purely subjective opinions 
but on data collection and analysis, which are difficult to 
dispute. Many practitioners have learned that, before com- 
paring the data between the institutions being benchmarked 
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the practice of compiling the benchmarking information, 
and making it available within their own institutions, helps 
create an environment that encourages colleges and univer- 
sities to reexamine their operations (Blumenstyk 1993: 
Detrick & Pica 1993). 

Another reason benchmarking has great appeal is that it 
is viewed as a positive process that helps institutional cul- 
tures develop learning and improving as goals. Robert 
(-amp ( 1992) stated the Japanese word dantatsu. which 
means "striving to lx* the best of the best . . . captures the 
essence of benchmarking that is a positive, proactive 
process designed to change operations in a structural fash- 
ion to achieve superior performance" (p. 3k Additionally. 
Camp added that institutional leaders in the I'nited States 
have no such word, because they always assumed that they 
were the best. Perhaps they still are in higher education, 
particularly in graduate studies, but global competition has a 
way o| upsetting longstanding monopolies. Xerox learned 
this lesson more than IS years ago. as Robert Camp indicat- 
ed in his 1989 book. Benchmarking: The Search for Industry 
Best Brat tices Then I.ead t<> Superior Performance. This book 
reports on benchmarking efforts in the I 'nited States at 
Xerox, which institutionalized the practice in its organiza- 
tion. and fully describes the 10-step benchmarking process 
used. Benc hmarking led to fundamental changes in how 
Xerox manages suppliers and develops products, and it 
continually forces the company to look at itself externally. 

Benchmarking offers the opportunity for practitioners to 
think "out of the box." as Michael Spendolini ( 1992) 
describes it. and to discover new ideas. Leaders and man- 
agers tend to work in their own "boxes" most of the time, 
where they have been successful and are comfortable. On 
occasion, they may look outside this box and see what the 
direct competition is doing, especially if there is financial or 
enrollment difficulties Benchmarking, however, takes a 
much more systematic approach at examining competitors 
and looking at processes externally. The four types of 
benchmarking described later (internal, competitive, func- 
tional. and generic) oiler the opportunity to break out of the 
internal box we operate in. and discover what process lead- 
ers in other industries and world leaders are doing to 
achieve greatness in a particular area, figure 3 illustrates 
the advantages of looking "out of the box." 
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FIGURE 3 — Thinking “Out of the Box’ 
(Spendolini 1992, p. 23) 
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Colleges and universities are known for staying cloistered 
inside the "ivory tower” and separated from the outside 
world. This is due partly to our history of training clergy, 
and partly to the natural barriers to change that develop in 
conservative institutions, that were built to preserve and 
transmit knowledge (Rudolph 19”’"’). In today s competitive 
environment, leaders in higher education must think strategi- 
cally and globally to survive. In addition to gathering data 
for process improvement, benchmarking is useful by college 
and university leaders lor strategic planning and lorecasting. 




because it develops knowledge of the competition, views 
state of the art practices, examines trends in product service 
development, and observes patterns of customer behavior. 
Benchmarking is a source for new ideas, process compar- 
isons. and goal-setting. It enables the benchmarking practi- 
tioner to see the organizational functions from an external 
point-of-view. and not be limited to the traditional method 
of developing ideas and objectives internally. 
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Benchmarking was developed out of the dire need to 
improve radically; it became obvious at one organization — 
Xerox — that the traditional "tried and true" method of devel- 
oping and producing a product was not working well 
because the competition had radically improved. 

Initiatives at Xerox 

By the early 19S0.s. Xerox was facing severe financial and 
competitive pressure. In less than a decade. Xerox's market 
share had fallen from more than Bo percent to about 35 
percent, and the company's costs and quality were creating 
huge problems ( Pryor h)X9). In I9~9. the company began a 
study to compare its manufacturing costs w ith those of for- 
eign and domestic competitors (Camp 1992). The findings 
ol that pioneering study showed that their competitors were 
selling products at a price equal to what it cost Xerox to 
produce them. After setting up benchmarking throughout 
the company. Xerox regained market share, dramatically 
lowered cost and improved quality, and saved itself from 
financial disaster. 

Other industries learned to use benchmarking, too. In his 
tollow-up book. Robert Camp ( 199s) wrote that, after the 
much publicized success of benchmarking at Xerox, other 
major corporations have begun successfully using bench- 
marking. such as Texas Instruments. Westinghouse. AT&T. 
IBM. and others ,\ review of the literature found that a vari- 
ety ol different organizations, including many service indus- 
tries. have also started using benchmarking, for example. 
Bergman < 199 0 stated that benchmarking is used in the 
field of health care as a management tool for improv ing 
clinical quality at Sun Health Alliance and the Cniversitv 
Hospital Consortium. One participating hospital was able to 
reduce the length of stay ol pneumonia patients from S 1 to 
to (».“ days. after the (.lata was collected on patients and 
compared with the results from other hospitals. 
Benchmarking is also used on health and disability benefits 
in the energy and communications industries (Tortarolo & 
I’olakoli 1 99s i. A competitive benchmarking study ol the 
largest I h) companies in those industries was the first proj- 
ect to identify the best practices and trends relating to health 
care and disability activities. It is clear that benchmarking 
has spread beyond production and warehousing operations 
at linns like Xerox, and on to improving pertormame in a 
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wide variety of organizational and administrative processes. 
a> well as cost concerns. 

Another field that is using benchmarking, which is closely 
related to higher education, is employee training practices at 
top companies (Kimmerling 1995). I he American Society for 
Training and Development (ASTI)) has created a Bench- 
marking Forum, designed to be a cooperative venture among 
companies with strong financial and organizational commit- 
ments to employee training. Forum participants plan to find 
and c atalog best practices by collecting information and pro- 
ducing comparative data against which to “pc.*g or bench- 
mark their individual training efforts. The Forum began in 
1991 with 19 participants, and grew to 5” in 1995. 

Participating companies include Aetna. American F.xpress. 
Boeing. Chase Manhattan, and many otheis. The 1991 bench- 
marking findings vieided both process and financial data, 
including ratios of training stall' to employees, training days 
per veai. the cost of training, types of training, etc. I he par- 
ticipants hope to measure* and improve the effectiveness of 
the* cmplovee training. This could have an effect on college’s 
and universities that provide undergraduate and graduate 
programs, contract training, executive education, and non- 
et edit programs for ASTI) Benchmarking Forum participants. 

Related to the ASTI) benchmarking effort, lord ( 1995) 
reported that benchmarking is applicable* to the area of 
human resources training. It has resulted in identifying tile 
strengths and weaknesses ol management s training efforts, 
lord stated: 



It is clear that 
benchmarking 
has spread . . . 
to improving 
performance in 
a wide variety 
of organiza- 
tional and 
administrative 
processes, as 
well as cost 
concerns . 



/hit id ( frith and his colleagues at the l nirersily of 
\ln higan hare already done some ground-breaking 
work. They conducted a large bench marking study of 
human resources i omf>cteucies and practices . ui.uch 
invoiced more than in.uuu individuals in 9/ r..V. 
firms hocusing on all HR functions, they collected 
sane i' from managers and employees in many Jane 
tioual area*, measuring perceptions of the companies 
human resources ilepartmeuts. 

Among the competencies they examined were* c'iglil in the 

1 1 KI > ck mum. 

• 'training ptogram design 

• training cleiiv cry 
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• career planning 

• career development 

• organizational design 

• autonomous work-group design 

• organizational restructuring 

• integration ot -business functions ( p. 3«S). 

The first two areas in the l lrich study, training program 
design and training delivery, show that corporations are not 
only benchmarking administrative processes and how much 
they spend on training, but how they train. Since compa- 
nies are benchmarking processes in higher education that 
we would label- as academic curricular, there is evidence 
that our college and university academic programs should 
also be able to use benchmarking effectively. This has 
already begun in some areas ol secondary education, such 
as technical education (Inger 1993: l.osh IW i). 

Ingcr ( 1993 > stated that educators normally look only at 
other schools for practices to borrow. Successful bench- 
marking can he used to look both inside and outside the 
field ol education for best practices. Because benchmarking 
foc uses on outcomes, it can be applied to "tech prep" as an 
organizational alternative to the traditional secondary school 
college prep and general education program. Inger believes 
that the follow ing components of tech prep are particularly 
well suited to benchmarking: articulation, program assess- 
ment and improvement, career guidance, and marketing. 
Many ol these overlap w ith functions in higher education. 
Benchmarking has also been proposed lor benchmarking 
technical education cicliivry systems as a method for 
improv ing vocational-technical education (l.osh 199 t). As a 
stall, a tech prep consortia in Arizona are establishing met- 
rics to benchmark a statew ide system, with the initial goal of 
discussing and ratifying the processes to be* measured by the 
participants. 

The Baidrigc* Award and Benchmarking 

As we have seen, calls for education to adapt strategies from 
business and industry arc* not new . Hven the famous 
Malcolm Baidrigc* National (Quality Award, the “icon" of cor- 
porate quality management improvement, has now been 
extended lo higher education (Seymour 199(9. The Baidrigc* 
Award was created in 19S“ by President Ronald Reagan, and 
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given annually to selected companies and other organiza- 
tions that practice effective quality management techniques 
that result in significant improvements in the quality oi their 
«$»<><>ds and services (Seymour 199-ta). To dale, more than 1 
^niliion copies of the Baldrige Criteria have been distributed. 
Htilmost 300 companies have applied for the award and there 
have been 2S w inners (Seymour 1990). Among the core 
values of the award is the need for management by fact, 
w here data and data analyses’ support a variety of organiza- 
tional purposes, including planning, assessing performance, 
improving the organization's structure and processes, and 
comparing its quality performance against the performance 
benchmarks of other organizations. The benchmarking 
process is an important part of the award criteria, which uses 
a rating svstem with l .000 possible points that award candi- 
dates strive to achieve. The "management by fact" core val- 
ue is achieved through required, competitive benchmarking 
in two of the 1 90S pilot education criteria categories (see 
__Appendi\ A). Criteria items number 2 — Information and 
Analysis (worth ~S points) and item (> — Institutional 
.^Performance Results (worth 230 points), both require that 
^colleges and univ ersities conduct benchmarking studies in an 
^ongoing manner, in order to receive the Baldrige points. 
rrThe best performers in this c ategory gather hard data to 
—'measure quality trends for key programs and services, com- 
^jxtre quality with national averages and national leaders in 
"comparable organizations, measure trends in overall perfor- 
mance of operational process and support services, and 
examine the quality of supplies and services furnished by 
other providers (Chaffee & Sheer 1992). The Baldrige office* 
at the National Institute of Standards and Technology is 
working with the Academic Quality Consortium from the 
American Association lor Higher education "to prov ide* cam- 
puses committed to implementing continuous quality im- 
provement the opportunity to learn and work collaborate civ 
by exchanging information, building on one another's expe- 
riences. and expanding on the* assessment practices already 
being utilized'' (Sevmour 1999. p. \i). An excellent desc rip- 
tion of these efforts are detailed in the two-volume set. 

"High Performing Colleges: The Malcolm Baldrige National 
Quality Award as a Framework for Improv ing Higher 
education" (Sevmour 199(9. The first volume covers the 
theorv and concepts o| the award, and the second volume 
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discusses the application and implementation, as well as 
valid concerns of the 199s Kducation Pilot award criteria at 
Northwest Missouri State I'niversity. led Marchese (1994) 
from the American Association tor Higher Kducation. wrote 
that. "The Baldrige will work in higher education, just as [itj 
has (and hasn't) in industry, when it is embraced by the 
internal culture as a tool lor improvement (p. 4 ). The use of 
benchmarking processes as part of Northwest Missouri State 
I niversity's pursuit of the Baldrige Award is further des- 
cribed in Chapter 3 of this report. In addition, the Baldrige 
Aw ard has sparked the creation of several state-level. 
Baidrige-type quality awards that are already being applied 
to higher education. For example, Kio Salado Community 
College received the Pioneer Award from the Arizona Quality 
Alliance in 1993 < Seymour 199 tb). Organizations using 
benchmarking and applying the Baldrige Award (or Baidrige- 
type) criteria clearly perceive themselves as leaders in their 
respective markets ( APQC 1993). 

Summary 

Much has been written about the need for change and 
improvement in higher education, and new paradigms, or 
models, of operation have been proposed to address these 
changes. Among them is the call for the creation of a more 
"learning centered. " organizational structure, w here the 
emphasis is not on traditional teaching but on what the stu- 
dents learn (Barr Tagg 1993). In addition, quality im- 
provement techniques developed in the business world such 
as TQM. reengineering, the Baldrige Award, and benchmark- 
ing are being used as tools in these new paradigms, or ways 
of thinking for colleges and univ ersities. Benchmarking, as 
described in the next chapter, is part of the new paradigm, 
and is fundamentally about learning. It oilers the opportuni- 
ty to see the organization from "out of the box." and pro- 
vides the methodology for a continuous process of 
comparing and learning for an organization. Hav ing faced 
turmoil in the global marketplace, other industries have had 
to change the way they operate, and they have used bench- 
marking as part of these changes. Benchmarking w as 
brought into the mainstream of management practices at 
Xerox in the early l 9 «S 0 s. since then, it has been used in a 
v ariety of industries, and has become part of the lexicon ol 
continuous qualitv improvement in the 1990s. The literature 




of business and education shows that iis populariw contin- 
ues io grow. and it is now being used in many colleges and 
uni\ ei sides. 
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As with mans other terms. benchmarking is often used 
incorrect I v or too broadly in regard to the 1 true and original 
definition. Benchmarking does not mean comparing num- 
bers for simple obtaining information on the perlormance ot 
an organization or difference between two organizations. 
Government agencies, in particular, have used '■benchmark" 
or "benchmarking to describe a procedure of devising per- 
formance or outcome measures to calculate an agenev or 
organization's progress toward impro\ement (PSQR IWi). 
Benchmarking is different from creating a set of 
performance standards: it involves continually comparing an 
organization's performance and learning from moving tar- 
gets. by identifying the process leaders. In a recent AS1IH- 
HRit: Report on the use of Performance Indicators in higher 
education, the authors commented on the difference in defi- 
nition. and staled that performance indicators are useful for 
comparing performance and quality among peers over time, 
w hereas benchmarks are useful for improv ing specific- 
processes in an institution by comparing to peers and adapt- 
ing techniques (Gaither el al. ld ( )t). 

Collaborative and cooperative learning have recently 
been promoted as techniques that college students can use 
to learn bv helping each other (Bos worth & Hamilton IbPn 
Mru flee lOPG. Since higher education is often viewed as a 
learning business, colleges and universities, as institutions, 
should also be inclined to learn from each other, and Irom 
other organizations outside higher education through the 
business-developed process called “benchmarking. One* 
benchmarking program manager defined benchmarking as 
"The process bv which organizations learn, modeled on the 
human learning process' (Watson IW3, p. 2). Leiblried and 
McNair t IPP2) also stated that benchmarking is analogous to 
the* human learning process: 

lieuchmarkiu, g. then. is a class mi learning hnic t<> 
learn The first Jcic lectures are simply to get your 
attention Once the groundwork is laid, the f>ace <>/ 
change aaek’rates. as erery nidiridual begins to t leapt 
the fau that the status tfuo is a dangerous bedfellow. As 
ut>i el a( proaches to organizing internal work are 
uncorered and measurements are derired to support 
them . attitudes change Pi’ople can become accus- 
tomed to change In fact, change can become exhila 
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rating. The final exam fur the class is conducted by the 
market; those that embrace change and strife fur con- 
stant m.prm emeut trill snrrire in the twenty- first centu- 
ry. 'those that remain mired in tradition trill yet failing 
marks. f>erhtif>s eren flunk uni o f school \ p. 3-3 >- 

There are many oilier definition-, of this relatively new 
management process hut. fundamentally, benchmarking 
involves analyzing performance. practices, and pn wesses. 
within it nd between organizations and industries, to obtain 
information for self-impmt ement. Institutions of higher 
education have been conducting external data gathering and 
comparisons for years, but benchmarking as defined here, 
also involves the search lor best practices. Benchmarking, as 
defined today, may be particularly appealing to the academ- 
ic community, due to its reliance on research methodology. 

This methodology is not unlike that practiced and taught by 
faculty and administrators in colleges and universities even- 
day. surveys, interviews, data collection, analysis, and 
reporting are all techniques with which most people in high- 
er education are very familiar. The other quality improve- 
ment techniques recently introduced to higher education 
often involve* using unfamiliar business labels and terminolo- 
gy such as "customer.” with w hich many in higher education 
are not entirely comfortable (Chaffee <X; Sherr 1W2). 

Therefore, benchmarking offers a new way of thinking, or 
paradigm, that may be more acceptable to personnel in 
academia. 

The definition of benchmarking is more focused than the 
other quality techniques, is easily understandable, and can 
be respected because it is data driven. Members of the 
Design Steering Committee at the* American Productivity and 
(Quality Center ( AI\X! > developed the 1 following definition: 
benchmarking is the process of continuously comparing and 
measuring {in urbanization irith business leaders anywhere 
in the world to gam information, winch will help the organi- 
zation take action to improre its performance t APOC. looy 
P " 

Another definition developed at the APUC represents a 
consensus among some Ion firms. 

Hem hmarking is a <\<temaln and 1 outinuous mens 
urement process, a process oJ\ onlnuunisly measuring 



and comparing an organization s htisine .« /»««"’■' 

business process leaders anywhere in die world 
to pain information, which will help the organization 
tape action to improve its performance t Watson 1'W. 

P- 31. 

The second definition adds that benchmarking should be 
inlegruied into the ongoing operations of the institution. As 
with t|ualitv efforts, it is ongoing because looking at 'he c a a 
longitudinally can Ire beneficial in showing the progress 
made Iw the participating organizations. A stagnant one- 
time snapshot of a process that has been benchmarked nut 
be interesting and even somewhat useful, but to see the 
success tor failure), over time of process changes and 
improvements, is much more valuable. Often, charting ant 
seeing the results of improvement ellorts can be very usclul 
in motivating those who are conducting the benchmatking. 
as well as to the customers of the process who will letent 
the benefits of any improvements enacted. 

Benchmarking Process Overview 

benchmarkings relationship with quality strategies is even 
more visible as the process is further defined. I he bench- 
marking process can be compared to the simple lour-step 
approach: Plan-Ho-Check-Act (inx'.A). as shown ,n figure .. 
Chaffee anti Sherr ( 1W2) and the other literature on quality 
also call l’DCA the Shewart Cycle, which was the tundamen- 
tal melhotl taught by management guru; Vi. f.dwatds 
Doming. 

FIGURE 4 — Benchmarking Process Compared w ith the 
Deining Cycle (Watson 1993) 
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Ihc fit sl .step in bench mark ing. as in the PI X'.A eycle 
stans with planning. For higher education, this means 
selecting and defining the administrative or teaching process 
lo lx ‘ sUKikxl - identifying how the process will be measured, 
:md then deciding which institutions or organizations should 
H studied. In other words, it involves planning what to 
benchmark and who-to benchmark with, if the benehmark- 
mg project will be more than an internal study (described 
later in this report). The second step uses primary and or 
secondary research to gather the data. This can involve 
i esea idling publiclv available information about the target 
colleges and universities through professional associates, 
posonal contacts. a library, or on-line computer serv ices. 

The primary research may involve direct communication via 
telephone surveys, written questionnaires. or visits to make 
c elailed inquiries. | he third step in benchmarking consists 
analv zing the data gathered. to calculate the research find- 
ings and develop recommendations. This i.s the critical 
point in study where the differences, or gaps, between the 
participants performance are identified, and from which the 
process enablers" are derived. I nderstanding and applving 
these enablers to the organization conducting the bench- 
marking study is the essence of (he benchmarking process. 

I ie overall goal is improved performance from these 
enable, is that weie learned from the other organization! s) 
and then adapted. Watson ( IW.i) summarized the following 
important p< lint: 

. 1 benchmark study produces tun results: Una measure 
<>J process performance excellence that can he used as 
a standard for comparison . . . and (I?) a determina- 
tion of the process enablers that helped develop the level 

<>/ performance observed These enablers are the 

key to improvin'* the observer compan y s performance, 
and their discovery is the real ;y>at if the benchmark- 
itti> study ( p. D. 

Adaptation ol these enablers lor improvement is the 
louilh and final step in the benc hmark process, m least in 
the first iteration ol I he cycle, for benchmarking to be truly 
etlec live, the process should be never ending. Organiza- 
tional leaders should never believe that ihev'can. or should 
Mop comparing their performance with others. 
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A detailed. 10-siep process was defined in Camp's first 
hook in Ih«S c ). and it is also widely used elsewhere. In his 
p)‘H follow-up companion hook, Ilnsincss Process liciuh- 
nuirfcing. (lamp stated that diflerenl companies have diverse 
benchmarking models w ith varying numbers of steps in the 
benchmarking process. They hav e similar terminology and 
overlapping areas, hut differing levels <>! process description 
(see figure s>. In addition to Xerox's 10-step process, there 
is a nine-step process at Alcoa, a 12-step process at ATXT, 
and a five-step process at IBM. All of these multi-step 
benchmarking processes can he looked at in conjunction 
w ith the four phases of the aforementioned PIX1A cycle. 

The first phase involves planning the benchmarking study 
hv deciding w hat organizational processes are to he bench- 
marked. to w hom these processes will he compared, and 
how the data will he collected. Alter deciding what. who. 
and how the benchmarking project will he conducted, the 
actual data collecting is done through primary and 
secondary research. There is no one correct way to conduct 
all benchmarking studies, and the different studies require 
different methods of gathering the information. Kecogni/ing 
that the purpose of benchmarking is not only to deriv e 
quantifiable metrics and targets, but more importantly , it is 
used to investigate and document the best practices that 
enable the achievement of the* goals and targets. The sec- 
ond phase contains the analy sis of the benchmarking data 
where the performance gaps between the organizations arc 
identified, and provides the objective basis on which to 
improve the process. The performance gaps must then be 
used for adapting improvement efforts, and setting operation 
goals for change. The plans for change should contain 
markers lor updating the benchmarking findings, because the 
external practices of the other organizations are constantly 
changing, or continuously improv ing. 

Benchmarking really has two important overall compo- 
nents or process groups: the* management of the bench- 
marking process and the user processes ((lamp IWs). I he 
processes described above are what the users of benchmark 
ing do. while the managers who supervise the overall proj- 
ect have their own broader process steps to establish 
support and sustain the benchmarking el fort, figure <» 
shows the* relationship between the management ol the 
beiu hmarking process with the step wise user processes. 

tu'iii Iwiiiikm i> iu Higher Idiu iitn>n 
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FIGURE 5 — Benchmarking process models (Camp 1995, p. 9) adapted from 
Camparing F roc ess Models for Benchmarking, American 
Productivity and Quality Center 
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FIGURE Ci — Benchmarking processes and phases 
(Camp 1995, p. 10) 








































Benchmarking provides an objective measurement for 
base-lining, goal-setting, and improvement tracking < Detrick. 
Magelli <S; Pica 199 D. It helps soil out what should be meas- 
ured. and provides insight to the inefficiencies of certain 
processes. Benchmarking is truly a learning experience for 
those managers that participate. Often, during the initial 
stage of planning of what to benchmark and the gathering 
of internal data, an organization learns immediately that 
there are obvious inefficiencies. This often happens in the 
consortium or association-type benchmarking studies, w here 
participants are first mailed a survey lorm to collect industry 
standards and then begin to fill in their own data on the 
form. However tempting this might be. this is not the goal, 
or best result possible for benchmarking. The benchmark- 
ing manager should ensure that the project team does not 
slow down and get too involved at the self-analysis stage. 

More importantly, benchmarking can help overcome 
resistance to change that can be very strong in conseiv alive 
organizations, such as colleges and universities, that have 
had little operational change in many years. It does this by 
reiving on data and analysis, which are difficult to argue, if 
the data are v alid and the analysis has merit. Decision-mak- 
ers in higher education, that have years of training and 
experience in academic or business research, often welcome 
data-based recommendations. However, benchmarking is 
not an end in itself, but rather a means to an end. which is 
organizational improvement. Researchers can easily i>et 
caught up in the details of data collection and analysis, and 
l they! should remember to beef) the goal of process improre- 
ment in sight at all times. 

In The Benchmarking Book. Michael \. Spendolini < 199 2) 
summarizes what benchmarking is. and is not. ('fable 1 1. 

As staled earlier, benchmarking is a continuous process, not 
a one-time event. Although it can hav e great benefits, even 
if performed successfully only once, the improvement 
gained can easily be lost as competitors improve their own 
processes. Benchmarking is not a process that provides 
simple answers through the numbers reported (the ■met- 
rics"). or in the process enablers that are the means lor 
achieving the belter numbers. It is a process that provides 
valuable information that needs to be incorporated, or 
adapted, into the organization that hopes to improve, and 
tan identify industry standards. W. Kdwards Doming offered 



. . . benchmark- 
ing can help 
overcome resis- 
tance to change 
that can be very 
strong in con- 
servative orga- 
nizations . . . 



licnchniurking m Higher lulucatitm 



3o 




the following advice on this. “Adapt, don't Adopt” (Watson 
p. 3 ). The process enablers are originally developed 
at the institutions that have best practices to meet their own 
specific needs, in their own specific environment. Since no 
two organizations or competitive environments 
(especially colleges and universities) are exactly alike, the 
process enablers need to be adapted to fit. Outright copy- 
ing of a business process, w ithout thorough analysis for 
organizational fit. can cause untorseen problems. 



TABIJi 1 

Benchmarking: What it Is and Isrf t 
(Spcndoiini 1992, p. 33). 



Bench marking Is 



\ continuous process 



A process ol investigation that 
prov ides v aluahle 
inlormati* >n 



\ piociss ol le. lining from 
others; a pragmatic sea nil 
f« n ideas 



A time-consuming. labor 
intensive piotess ivc|tiirmg 
ilis(. iplme 



A v iable tool that prov ided 
useful information tor 
improv mg \ irluallv any 
business .u tiv itv 



Benchmarking Isn* t 



A one-time event 



A process of investigation that 
that prov ides simple 



Copving. imitatin' 




CHiic k and ease 



\ hu//\\ord. a lad 
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This is whv benchmarking is not as c|uick and easv as it 
first seems. Although benchmarking is not difficult. il does 
require sufficient planning, employee training, lime, and 
financial support. The costs will he discussed later, howev- 
er. practitioners of benchmarking in higher education report 



















that the return-on-investment is very respectable (AACSB 
199 i: NACl’BO 1995). Benchmarking is effective in higher 
education for several reasons. First, it is easy to understand 
and implement by all levels of employees in the organiza- 
tion. for all kinds of processes. Second, many companies, 
such as Xerox. Motorola. IBM. and others, have been using 
it for years (Spendolini 1992). Third, benchmarking uses 
reliable research techniques, such as surveys, interviews, 
and site visits, which provide external and objective meas- 
urements for goal -set ling, and for improvement tracking 
over time. 

Thomas I. Sergiovanni ( 1995). a leading w riter on educa- 
tional administration, commented that school administrators 
tend to jump at every latest management fad. This may have 
some truth; however, most of these adapted management 
strategies do have one thing in common; the key to produc- 
tivity improvement lies in performing better through continu- 
ous organizational learning (Marchese 1995a). w hich is what 
benchmarking also offers. Benchmarking is clearly more 
than a lad. It is a learning experience for those who partici- 
pate. because its method forces participants to analyze and 
compare continually, identify industry standards, and set the 
definitions for performance. Just as there are different kinds 
of learning that can be planned, the suitable form of bench- 
marking should also be chosen. The literature reviewed 
shows there are at least four kinds of benchmarking: 

• Internal benchmarking 

• Competitive benchmarking 

• Functional Industry benchmaikmg 

• Generic benchmarking 

Benchmarking can be conducted against internal opera- 
tions. external direct competitors, industrv functional lead- 
ers. and generic processes ((.amp I9K9). Fach tv pc ol 
benchmarking has advantages and disadvantages, and some 
are simpler to conduc t than others. The manager in charge 
of the benchmarking projec t should look at each type to 
determine* if it is worth the* cost and effort to yield the 
desired information, fable 2 contrasts the main advantages 
c >f each benchmarking type. 

Intern. il and compe titive* hem hmarkmg have the most 
relevant data to the- operation being benchmaikcd. 
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Table 2 



Key Benchmarking Characteristics 
(Camp 1989, p. 57) 
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However, neither of these processes usually results in 
obtaining world-elass breakthrough innovations. The other 
types, except for competitive benchmarking, are not ham- 
pered by obtaining sensitive information that may be confi- 
dential. However, the industry and generic processes are 
more difficult to benchmark, because the prac titioner must 
decide how to adapt the best practice's to the home organi- 
zation. which may be in a different industry. The most sig- 
nificant benefit of benchmarking lies in discovering the 
world-class leading processes in a parallel process, usually 
in a different industry. This is how Xerox moved forward in 
the reproduction industry by competitively benchmarking 
warehousing and distribution processes Irom L l.. Bean, 
which is iii a completely different industry. 

Internal Benchmarking 

Main organizations that are highly decentralized, such as 
colleges and universities, can lake advantage of a highly 
cost-effective method called "internal benchmarking." This 
is a type of benchmarking in which processes are compared 
between operating units, divisions, or sister companies 
(Watson IW^l. for institutions of higher education, this can 
mean different departments, or schools, w ithin a college or 
univ ersity, for example, faculty hiring processes could be 
benchmarked between the humanities, education, and the 
scieme departments, or a graduate school o< business could 
benchmark its graduate admissions processes with other 
protessinn.il graduate schools. These internal benchmarking 





















studies can produce detailed data about process improve- 
ment opportunities, because the usual hurdles ol access 
and cooperation from other institutions will he reduced il it 
is done within one college or university system. Internal 
studies can also help the organization locus on the critical 
issues to he* examined, provide uselu! information by them- 
selves. and define areas for future external investigations. 
Although it has these benefits, internal benchmarking has a 
lower probability ot achiev ing significant breakthroughs, 
because comparable departments within one college sWem 
lend to have relalivelv similar practices and processes com- 
pared with external organizations. 

Competitive Benchmarking 

A more common tv pc of benchmarking locuses on measur- 
ing perlonnance against peer or competitor organizations 
TIk* goal of competitive benchmarking is to study the 1 prod- 
uet designs, process capabilities, and or administrative meth- 
ods used by an organization's competitors or peers (Watson 
'['his is one ot the* primarv goals ol the assoiiaiion- 
spnnsoied benchmarking projects in higher education. Mich 
as the NAClltt) studv < National Assoc iation ol College* <ind 
t'niversiiv business Officer). which v\ ill be described m 
detail later in this report. Institutions o{ higher education 
arc verv familiar with classifications, such as the Carnegie 
classification system, public versus priv ately-lunded. small 
colleges versus large universities, the Ivy League, the big 
fen. etc. The participants in competitive benchmarking 
seek to analv/e their processes directly against those organi- 
zations with whom thc\ have similarities but on processes 
that muv not be particularly sensitive. Watson t P»s) stated: 

x Indies <>f fhi> lyfte differ from /true ess hem hmarkm g 
similes in tenn.s of their def>th. <md the fact that Iheir 
t>(Kii lem/s In end irilh measurement. rather than mil > 
imfilemeudug ft me ess enablers, (.'unified! u c bench- 
marking shades may he conducted tfiiwlly with cum- 
fiedturs on benchmark f) rue esses that are 
uoncuntrurcrsuil. such as jiu. Ilides management. inter 
na! auditing f tract ices . human resource fnacdccs. 
emftluyce safety and health, cumficusdtiuU and benefits, 
eniftluyee training and derelufnnent. (fiiahty ftrugrams 
and methods, fmrehasin g and sitftftfier management. 
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and industrial jail icy issues. ( )fteu these studies are 
conducted by a third / tarty to sanitize the conif)etitire 
in(brmati<m. uomiua/ize seusitire performance infor- 
mation to an agreed <>n base measure, and re[)ort case 
study information that has been approved by the con- 
tributing company < p. 109 >. 

It is easy to sec why third -pa riics. such as professional 
associations like \.U .1 lie ). the Association tor (‘.ontinuing 
Higher Education tAt-lll : k or private consulting firms like 
the American Producin' il\ and Quality Center ( APQO. and 
Educational benchmarking Incorporated are popular 

methods by which colleges and universities enter the bench- 
marking field. Benchmarking practitioners often ask for a 
neutral and external standard for institutional comparison of 
processes, \lter internally analyzing a process and deter- 
mining a Iviuhmaik. a manager ty picalh may ask if this 
result is really good. and it' so. compared with w hom 
< I Viric k vK Rica I WC Kush PW 1 1. Another reason for seek- 
ing external third-parts analysis tor competitise benchmark- 
ing. particularly for large organizations, is that one-to-one 
comparisons with competitors can raise concerns over possi- 
ble antitrust violations and unfair trading practices (Watson 
1 t ) t > A >. Aome information may be impossible to obtain 
because it is proprietary, and it is the reason for an institu- 
tion's competitive 1 advantage (Camp IdSUi. However, while 
obtaining information may be not he easy, it should never- 
theless be pursued, peihaps by using third party assoc iations 
or consultants to guarantee confidentiality and anonvmity. 

Functional Benchmarking 

Also called industry benchmarking. Junctional benchmarking 
is similar to competitive benchmarking, except that the 
group of competitors analyzed is larger and more broadly 
defined t Rush |W‘)|i Robert ( amp < inwS ) defines Junctional 
bene hmarking as a comparison of methods to companies 
with similar piocvsses in the same function outside* one’s 
lndustiy ’ (p. 1 st This kind ol benchmarking presents a good 
opportunity to produce bieaklhrough results by analyzing 
high performing processes and learning the process enablers 
ftom these industry -w ulc* organizations < W atson lh‘H>. 

Xerox found, through functional bcnchmaiking. that it 
could look outside its industry for best practice leaders and 
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relate it to an overall compart} -w ide benchmarking effort. 

As briefly described in the first chapter of this report. Xerox 
realized that it needed to radically improve performance ami 
decided to look at a warehousing and distribution process 
leader in another industry- — L 1.. Bean. 

Despite their differences, the similarities between Xerox 
and I.. 1.. Bean were very efficient operations, designed with 
the full participation of the hourly workforce, and they used 
quality circles to do it (Camp 19S9). L L Bean was identi- 
fied as a best practice leader in the area of warehousing and 
distribution through an article published in a trade periodi- 
cal. Since Xerox and L L Bean are in two very different 
industries, the problem of confidentiality was reduced, and a 
distribution manager at L L Bean agreed to a site visit by 
Xerox personnel. The visit was conducted, and data was 
gathered and compared between the two organizations. 

L L Bean also learned about the benchmarking process 
itself and began visiting other firms (although, not X ox) to 
learn from them, as well. 

For colleges and universities, functional benchmarking 
means analyzing institutions outside of one's Carnegie classi- 
fication or funding tvpe. as well as organizations outside ol 
the field of higher education altogether. Possible functional 
or industrv benchmarking partners might train and educate 
divisions of large firms, private training companies, elemen- 
tary or secondare schools, or new nontraditional. computer- 
based distance learning programs. Looking within a 
narrow Iv-defined competitive group ol organizations has 
obvious limitations in a rapidly changing world. This is win 
functional benchmarking can be one of the most productive 
and cost-effective benchmarking types. The objective is lor 
the colleges and universities to learn about competitors in a 
general wav. rather than specifically (Thor IWS). Overall, 
the goal of both competitive and functional benchmarking is 
to identifv t he* best operational prac tices and processes that 
can Iv adapted or learned from t he* leaders. 

Generic Benchmarking 

Generic benchmarking, also c alled "hest-in-c. lass, usc-s the 
broadest application of data collection from different kinds 
ol organizations Generic bene hm. irking compares work 
pn k esses at < >ne < ugani/alic m to < alters who hav e truly inm > 
v. Hive and exemplar} pet form. mce << lamp inust. Generic 
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bene hm. irking. which i.s also known us "best-in-class" 
bene hmarking. Ku.sh ( lWU slated: 

. . . seeks oat those organizations with the best practices 
regardless of the industry. The basic criterion is. IV ho 
performs this actiritv best > As a result, a college or 
unirersity might compare itself to an airline s purchas- 
ing process, a credit card company s hilling fwocess. or 
a manufacturer's facilities maintenance operation. 

(p. 90) 

The value ol generic hendimarking is dial an organiza- 
tion is not restricted to a competitive or industry group of" 
institutions, and is equipped to look at important internal 
processes, generally for analogous processes elsewhere 
(Watson RTH). The difference between functional and 
generic benchmarking is that generic benchmarking seeks to 
uncover the "best of the best" practices, regardless of indus- 
try. I he organizations doing the functional benchmarking 
must understand how the processes can translate ac ross 
industries, and they need to look for the leaders accordingly. 
Therefore, generic benchmarking is probably the most diffi- 
cult benchmarking type to use. but can hav e the highest 
probability for long-term returns. This creative approach 
can often result in changed standards and a complete 
reengineering of business operations. Robert Dale ( 199s). a 
benchmarking consultant to higher education, recently held 
a conference where he slated that reengineering is really the 
natural result of benchmarking. If. during a benchmarking 
project, it is determined that the processes under sc rutiny 
need to be changed entirely, then complete process reengi- 
neering may be the proper tool. However, if only minor 
adjustments are needed, or change’s arc* required in other 
areas of the organization, then reengineering may not be the 
tool Idr this job. benchmarking and reengineering are relat- 
ed techniques, but they have dillerenl purposes and uses in 
an overall quality improvement effort. 

I'uch ot the four benchmarking types can be important 
tools for process analysis and quality improvement. The 
tv pc’ that should be used depends on the kind of process 
being analyzed, the availability of data, and the* accessibility 
ot potential benchmarking partners for the college or univer- 
sitv conducting the benchmarking stuck. Regardless of 




which benchmarking type i> used. the purpose is still the 
same — to help the organization continually learn from other 
organizations (Camp PTH). This is done by analyzing the 
operation, knowing the competition and industry leaders, 
incorporating the best of the best, and finally gaining superi- 
ority to become the new benchmark for others to seek. 

Focus and Approach 

The literature on benchmarking contains different focuses 
and approaches to benchmarking. There are two primarv 
kinds ot focus levels: strategic benchmarking and opera- 
tional-level benchmarking, and primarily two approaches to 
benchmarking, problem-based and process-based. In his 
book titled Strategic lienchmarhin g. (iregurv Watson t PTH) 
stated that strategic benchmarking is different from opera- 
tional benchmarking in that it concentrates on: 

• Bnildin g core competencies that trill help sustain cowpeti- 
lire advantage. 

• idrgeting a shift in .s7/v#/c't*r such ns dereloping nett' prod- 
ucts or entering new tnnrhcls. 

• Dereloping n new line of business or tnahmg nn acquisi- 
tion. 

• Creating an organization that is wore capable of learn- 
ing. t pp. ,HH i > 

With a strategic focus on benchmarking, the organization 
looks at its overall competitive strengths and weaknesses to 
understand and develop competitive product and service 
strategies (damp PTH). The strategic focus establishes goals 
for product or service performance, customer support levels, 
asset usage, and financial usage. It also develops the kev 
practices needed to achieve the’ strategic goals. I his helps 
the- organization to take 1 an external focus on their industry 
trends, overall direction, and basic product or service olfer- 
ings. 

In comparison, operational benchmarking is used to 
understand spec ific c ustomer requirements and the best 
practices to achieve* customer satisfaction In improving 
internal organizational processes. This is also called "func- 
tional" or "practical benchmarking." and is most useful l<> 
mid-level managers, because it enables the* employees c loser 
to the customer to become the* competitor of choice. 
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Examples of operational benchmarking at a college or uni- 
versity include functional processes in offices such as pur- 
chasing. admissions, bursar, registrar, and other customer 
focused areas. Kush < 1Wi> wmle a partial list ol administra- 
te e areas for operational benchmarking at a hypothetical 
university, which is detailed in fable 3 Rush also stated 
that a university executive might ask. why should costs, such 
as processing a purchase order or an application for admis- 
sion be important? 



TABLE 3 

Functional Benchmarks in Higher Education (Rush 1994) 
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The answer is that these are the types of processes that 
drive a significant portion of the costs at colleges and uni- 
versities. The pav roll of the personnel and the aggregate 
transaction costs of items, such as those stated above, can 
be cjuile large. For example, if an institution is processing 
I s.nnn admission applications per year at a cost of S.V each, 
the institution will spend SiSLOUO on that activity each year. 
\ .->() percent reduction in ituliv idual transaction costs would 
vield a savings of x| i i.^nn per year. Operational bench- 
marking. although perhaps not as appealing to senior level 
administrators as long-term trends and goals, is nevertheless 
verv impoitanl to organizational survival in a competitive 
cm ironment. 



































Aside from a strategic or operational focus. benchmarking 
can also have either a problem or process-based approach. 
This involves how benchmarking is u > be initialized and 
used in the organization. In a problem-based approach, the 
activity is characterized as uncontrolled, because there is no 
specific plan for the benchmarking effort (Clamp 199s). In 
this approach, benchmarking is conducted on a problem-by- 
problem basis as organizational troubles occur. A more 
thoughtful approac h is process- based, where benchmarking 
is part of Lin overall quality and continuous improvement 
effort, and should be planned for accordingly. The process- 
based approach can be successful in bringing order to man- 
aging benchmarking within an institution, and for high 
efficiency, it should be applied only to the v ital lew busi- 
ness processes. It can be inelficienl and unwieldy to bench- 
mark too many processes or only certain ones identified In 
noticeable problems. 

Another perspective on benchmarking is th;ii it clih differ 
in the view it provides an institution < NACl BO 199s). 

Vertical benchmaiking seeks to quantify the costs, work- 
loads. and productivity of a predefined functional area, such 
as undergraduate admissions or accounts payable. 

Horizontal benchmarking measures the cost and productiv ity 
of a single process that goes ac ross more than one* function- 
al area, such as processing ;t travel request or purchase 
order. More corporations, nonprofit organizations, and insti- 
tutions of higher education are using benchmarking as the 
key tool for making both strategic and ope rational c hanges, 
on problem and process-based approac hes, and horizontally 
or vertically within their structures. 

Criticisms of Benchmarking 

Despite liII of the positive recommendations tor benchmark- 
ing cited in this report, there are critics of the benchmarking 
process and its applicability to higher education. Wolverion 
( 199 i) staled that benchmarking, as a cornerstone ol C( v )l in 
higher education, is based only on current ink nutation, and 
may tun give ih the freedom and flexibility to sev the luture. 
In addition. Wolvcrton Lidded 1 1 i:it this foc us may relegate us 
to the role of follower, instead ol leader. In writing about a 
related quality improvement technique, business Process 
Reengineering <bPR). Hammer and ('lumpy < 199.4) added 
that: 
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t he problem with benchmarking is it can restrict the 
Rci ‘Hgineenug team s thinking to the framework of 
what i> already bail" i/oite in its com/iany's own 
industry Hv aspiring only to hi' as g ood as the best in 
its iin/ustry. the i Reengineering/ team sets a cap on its 
men ambitions. ( sed this way. benchmarking is just a 
tool for catching ///'. not for jumping way ahead 

(p. 1 

This is ;m important point. because many business ami 
education writers believe dial benchmarking imolvos only 
examining the same institutional sector (i.e.. liberal ails col- 
leges should only benchmark liberal ails colleges). 

However, we have seen lhai functional and generic-type 
benchma' king do reach across industries, ami can indeed 
■■jump way ahead." In addition, it must be remembered that 
benchmarking is onl\ one ol many cjualily improvement 
tools that faculty and administrators can use in different 
situations, .since reengineering involves “a lumlamenlal 
rethinking and radical redesign ol business processes to 
achieve dramatic improvements in critical, contemporary 
measures of performance . . . ' (Hammer <X. (khampy. BTH. 
p jl). benchmarking may lx 1 appropriate only where the 
process can be improved immediately by this method, and 
not need a complete redesign as provided by reengineering. 
On the positive side. Hammer and t.hampy stated that 
benchmarking can help a reengineering team by sparking 
new ideas, especially if companies are benchmarked I mm 
< mtside their ovv ti industry . 

Robert Pedersen ( IW_!). from West \ irginia l niversity, 
<|uestioned the applicability of all recent quality improve- 
ment techniques to higher education, and stated that bench- 
marking and T( V )M are merely strategies for marginally 
improving existing processes, which seek to bring results 
more- closelv in line* w ith expectations. He believes that the 
costs of such analyses frequently outweigh any possible 
benefits, and lack strategic vision. Another colleague in 
(.heat Britain. David Kerridge ( lPbsi. added that the whole 
concept ol benchmarking is foreign to the true Deming phi- 
losophy. and stated that organizations do not need to know 
how good they are now and how they c ompare with others 
in order to make improvements. Rebecca C.hristianson 
( p)Us) at Michigan Technological I'niversity. staled that 
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Ixmchmarking can haw an impact on administrative prac- 
tices. such as the registration process. but would like to see 
it applied to the teaching and learning processes. However, 
she is concerned that many t acuity members seem content 
with the current leaching evaluation system as it stands now. 
and that a recently implemented fast feedback system lot* 
quality improvement is mostly perceived as a nuisance. 
Although these comments are anecdotal in nature, they are 
useful for understanding the concerns one may hear in a 
college or university. and have largely been addressed by 
the true definition of benchmarking as discussed earlier. 

At a recent conference of the American Assembly of 
Collegiate Schools of Business (AACSB). a workshop was 
offered on benchmarking and Management Bducation 
'leaching and Curriculum (Bateman 199 1 ). The discussion 
focused on how benchmarking was used for improving 
teaching and curriculum in the Graduate School ol Business 
at the I niversitv ol Chicago. I or purposes ol discussion, the 
following "straw objections' to the benchmarking were 
offered to the workshop participants: 

• euphemism for copying. 

• Deterrent to innovation. 

• ( )pporlunilv for plagiatism industrial espionage. 

• Promoter of inferior tactics since not invented here. 

• Exposes organizational weaknesses. 

Most of these concerns were addressed in previous sec- 
tions on the definition of benchmarking and what it has to 
offer, such as W . Pdwards Deming's comments on the haz- 
ards of copving without adapting. Other researchers, such 
as Dr. Howard Gitlow. have staled that an "example is no 
help in management unless studied with the aid ol theory. 
To copv an example of success, without understanding it 
with the aid of theory. may lead to disaster” (Dale 199S. p. 
\2). Plagiarism ami industrial espionage could indeed be 
disastrous, but lliev tan be avoided il the benchmarking is 
done properly and the cotie ol conduct is followed (see 
Appendix ID. The lack of opportunity for innovation was 
also addressed in the previous discussion ol benchmarking 
anti its relationship to reengineering. Real innovation and 
breakthrough processes tan be achieved, especially il an 
organization goes bevond benchmarking competitors, and 
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Joes industry or generic benchmarking of world-class head- 
ers. and adapts the processes back to the home industry. 
Benchmarking offers the ability to look externally at a very 
closed-minded organization or industry, which may believe 
that any processes, not invented within, are inferior. The 
practitioners of benchmarking state that it is difficult for 
laculty and college administrators to argue with data, and 
are therefore more compelled to make changes, than if the 
basis for change would be more subjective ( Detrick el al. 
I l Wt: Detrick cx Pica 1995). in addition, most benchmarking 
minimizes exposing organizational weaknesses, because the 
processes being examined are often not that confidential, 
and the benchmarking partner may be in a completely dif- 
ferent industry. 

Summary 

Despite these concerns and criticisms, benchmarking is cur- 
rently being user I successfully in colleges anti universities. 

As stated earlier, it is important to remember that bench- 
marking is more than just obtaining comparative numbers, it 
is part of a learning process within an organization. Bogan 
and I’nglish t IPPn commented on the difference between 
benchmarking anti benchmarks. Thcv stated: "benchmarks 
< italics added* are measurements to gauge the performance 
of a function, operation, or business relative to others." 
whereas benchmarking is the "ongoing search for best 
practices that produce superior performance when adapted 
and implemented in one's organization" (Bogan and Hnglish 
199 i. p. it. since institutions of higher education profess 
learning, and value hard data, using benchmarking to 
improve our processes is a natural extension of what we 
provide to college students in the classroom. 
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The use of quality and continuous improvement techniques 
in higher education is in its lourth year, with campus cflorN 
now numbering in the hundreds (Marchesc WOSb). Several 
dozen of the more advanced programs involve benchmark- 
ing. conducted through consortia, prolessional associations, 
consulting companies, or individual efforts as it was original- 
Iv done in the corporate world. Some of the projects to be 
examined are small and concentrate only on one area ol 
academic or administrative processes. Other benchmarking 
efforts are larger and examine nearly every unit within the 
entire college or university, bach style, or method of con- 
ducting a benchmarking study, has benefits and drawbacks 
and should be c hosen carefully by an institution considering 
benchmarking, first to be examined are the benchmarking 
studies sponsored by professional associations and consor- 
tia. such as the NACl BO project, graduate business schools, 
and continuing education (ACIIkf Then, a w ide selection 
of individual institution benchmarking efforts and interesting 
comments from some ol the* participants will be’ explored. 

The NACUBO Project 

Business officers are more aw are than anyone eke ol the 
financial pressures that face higher education todav clue* to 
spiraling costs and tuition, cutbacks in financial aid. the 
et I'ects of a stagnant economy, decreasing state budgets, 
institutional operating budgets, and the costs of capital and 
qualitv improvement. In Who. the* National federation ol 
College and I niversity Business Officers Association issued 
a report known as the* Sixtv College Study, which compared 
financial data fora nationwide sample of well-known liberal 
arts colleges ( Bowen l OS I ). 1 he* results ol this comparative 

stuck found wide differences in total educational and gener- 
al expenditures per student for institutions of comparable 
si/e and mission. Before benchmarking was developed, 
most inter-institutional studies were firmly set on comparing 
onlv comparable organizations (not going outside* ol cohort 
groups), and Ihcv did not attempt to identify those institu- 
tions with best practices as true benchmarking docs. A simi- 
lar stuck was conducted In the Carnegie Commission on 
Higher l‘dueaiion in W~l. which assembled data on educa- 
tional and general expenditures per I'l l! student for colleges 
and universities ol various tvpes. 

frit >r l< * the current bene hmarking pit >ject. \A( !CB( ) 1 1 >n 
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ducted :t study in the hue 1980s in cooperation with the 
Council lor the Advancement and Support of Education 
(CASIO which compared college fund-raising costs (McMillen 
1990: Ryan 1990). This four-year study produced workable 
standards for capturing comparative costs useful to college 
administrators in fundraising, alumni administration, and 
public relations. fifty-one institutions of higher education 
that completed the study reported their expenditures and 
gift income for the fiscal years 198s- 1988. The study found 
that, on average, colleges spend about lb cents to raise SI 
in fundraising: however, the CASK report cautioned against 
simplistic reading of comparative study results, because the 
goal in fundraising activities is to maximize the net returns, 
not juM to ha\e the best percentage ratio. Although not 
labeled as such, it can be \ iewed as an earls - benchmarking 
effort and shows the value of comparative analysis in higher 
education. 

The rec ent leading effort to address these problems with 
benc hmarking was begun in late 1991 by the National 
Association of College and l 'Diversity Business Officers (AIK 
199-1: Kempner 1993: NACl'BO 199s). Nearly 1st) colleges 
and universities participated in the two-year pilot, which 
involved more than l.buo individuals on to campuses. The 
project began by covering close to t() functional areas with 
approximately bOO benchmarks, and it has been refined over 
the past four years based on participant feedback. 

Currently, in the fiscal Year 199s NACl’BO project. 2b core 
functions ( l t fewer than when it started), plus two optional 
areas are offered in the benchmarking study. The goal of 
the* NACl 'BO project is to encourage participating institu- 
tions to work together to discover best practices and provide 
institutions with the data they need for improvement of 
operations, that mav cost too much or provide low quality 
service. The study is conducted by NACl'BO. with the help 
of the Higher Kducalion Consulting Croup ol the firm 
Coopers Nr l.ybrand. and three other consulting firms. The* 
cost of participation has decreased since- the* project first 
began in 1992 and varies depending on the* scope and num- 
ber ol business functions. The current costs range from 
ss.nun to si i .(Kio and include new options that measure 
internal staff customer satisfaction. Typical processes within 
college and universities studied cover areas such as general 
accounting, alumni relations, accounts pavable. admissions. 




accounts receivable. student registration, development, pay 
roll, and purchasing. An example ot the kind ot data pro- 
vided to participants is detailed in Tabic t. which shows 
selected admissions benchmarks lor different institutional 
types: public research, private research, public comprehen- 
sive. private comprehensive, and liberal arts. 

TABLE 4 

Selected Admission Benchmarks (Kempner 1993) 



Median applicant** .o a percentage of inquiries 
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The \ \Cl HO benchmarking Project is different from 
earlier comparative studies because it does not seek u> justi- 
|\ more dollars from state governments and donors, but 
seeks to use the results to cut costs and improve productivi- 
ty ( Massey & Myerson 199 »». Traditionally, institutions have 
been primal ilv concerned with inputs and costs, where 
improved quality can only be achieved Irom greater expend 
ituies. benc hmarking is diflerent. because it focuses on the 
outputs and quality of services, not the inputs 

Dilferent colleges and univetsiites have decided to use 
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tin- data provided by the NACl BO project in different ways. 
s ome participants, such as the State Cniversity of New York 
.it Buffalo, usee.! the benchmark data to improve the procure- 
ment practices in the purchasing office. Others, such as the 
W heaton College in Massachusetts, used the benchmarking 
data to ensure that the TQM and Business Process Reengi- 
neering efforts address areas with the greatest potential for 
improvement ( kempner 1993). The* NACl BO data offers 
the opportunity to introduce the concept of reengineering 
for those processes that need to be completely redesigned. 
This high-profile project has greatly increased the awareness 
of benchmarking w ithin the held of higher education, and it 
offers insight into the correlation between the financial cost 
inputs of resources and the outputs of operational serv ice's. 

Ml Jo campuses and the system offices of the California 
state* I niversity participated in the 1993 NACl BO project 
•Sundstrom 1995). They limited their participation to cover 
the' accounts payable, admissions, central budgeting, facili- 
ties. tinaikial aid. general accounting, treasury and cash 
management, human resources, payroll, procurement, regis- 
tration and records, student accounts icceivable. and billing 
t here were a total of I “2 institutions in the 1993 project, 
and Cal Stale made* both extramural comparisons with repre- 
sentative cohorts and internal comparisons with other sys- 
tem campuses. When asked what quantifiable quality or 
elliciencv improvements resulted from the NAOBO partici- 
pation. David Sundstrom. I mversitv Auditor, Mated: 

In a nord. there were many [xtsilire results from bench - 
marking. Sixteen of our unirersilies are {Hirticifatin y 
in the /995 froject. U e think that ice learned a lot 
from our first year's efforts and knotc tiuil this year 's 
( fata n il! he more act urate and ciituahte. We also look 
forward to louyilutlinul studies to yet a belter uuder- 
s tanduiy of the fositire effects of the many process 
reeuyiueeriny (irojei b t/kit are underway ( p. 2 k 

However, not everyone* agrees that the- NACl BO project 
is useful, or appiopriatc. as it is concluded. Sonic* partici- 
pants Believe* that there' is too high a level of data aggrega- 
tion. and that the* results arc* too detailed to be reallv useful 
(Bateman 199 n. <)nce the- participants receive the rather 
large benchmarking report from NACl BO. the 1 results mav 
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often be passed around from one office to another with little 
accountability for implementation. Others belie\e that what 
is missing from the NACl'BO studv is the participation of the 
customer, or user ol the data, from each of the institutional 
units. In addition, the lack ol information on academic 
departments, and the unavailability of cohort information for 
nonparticipants has also been criticized (Gaither el al. 199 it. 
Bruce Stark from Colorado Stale I ’niversity added that he 
sees no correlation between what NACl'BO did and true 
benchmarking, as defined in Robert Camp s L9<S9 bench- 
marking book, because they did not follow the original in- 
step process outlined (Stark 199S). hi addition, the 
NACl'BO does not appear to find the “beM of the best" In- 
looking outside the field of higher education, as Xerox did 
when it looked at the operations of l.. I.. Bean, stark sug- 
gested that colleges and universities might start by looking 
at internal training programs, such as Motorola I'niversity. 
where then often do a belter job of assessing the 1 training 
and educ ation needs of their people* than higher education 
does. Some of these criticisms have been heard by 
NACl'BO. and the ongoing benchmarking project is still 
evolving with each yearlv iteration. 

GMAC/EBI Benchmarking Project 

Business schools often teach about TQM. BPK. and benc h- 
marking topics in their undergraduate and graduate courses 
and programs. Recently, these techniques have also been 
used to improve the quality of the* cleliverv and administra- 
tion of graduate business programs. W hen members of the* 
American Assembly ol Collegiate Schools of Business 
(AACSB). the main accrediting body for business schools, 
and the Graduate Management Admission Council Ui.MAC) 
began to consider benchmarking activities of their members, 
two individuals stepped forward to conduct a pilot studv 
(AACSB 199 1 ): Joe Pica, assistant clean and MBA program 
director at Indiana I niversitv. and Glenn Hetrick, an educa- 
tional consultant and former vice* president ol educational 
programs with the* GMAC. Thev worked with business 
schools in the* Big Ten Conference* to conduct a pilot be nc h- 
marking studv in the l99C9i academic* year. Participants 
Iron i the sG tools met to disuiss amiiiiiii) pr< >blc*ms thev 
fated and to consider solutions using benchmarking. Pica 
staled. "I vc* always believed in tact -bused decision-making 



fk'tu bnutrl'mx tn f /r.i»/><r/ du< <Hi<>n / I 



56 



. . . when we first discussed the pilot study, we found that 
our colleagues were very moti\aied to obtain hard data, but 
their desire for information was beyond their ability to col- 
lect it” (A AC 'SB P)9t. p. lb). The pilot study showed that a 
group of competing schools could be lorthright about their 
own institutional processes and could share potentially sen- 
sitive information. The study established a basic language 
and standards for data reporting, because common defini- 
tions of simple terms for graduate admission processes did 
not exist before. In addition, it was reported that just partic- 
ipating in the study provided a useful means ol measuring 
internal operational effectiveness, even before competition 
data was received. This comment is echoed by participants 
in other benchmarking studies, including the ACHK project 
discussed next. One real value of benchmarking is this 
introspection, which forces participants to go inside their 
ow n institution, collect information, and raise questions 
t Detrick <S Pica I'Wsi. During the- first year of the pilot 
stuck, benchmark data gathered from business schools 
included processes such as those in fable 

Ollier benchmarks were also gathered on demographic 
and biographic application information. Representatives in 
the pilot study found that participating was a positive expe- 
rience. and has been helpful in self-analysis, in preparing 
budget requests, and in getting additional resources, for 



TABLE 5 

Sample GMAC/EBI Benchmark Processes 
(Detrick et al. 199*0 
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example. Don Bell. MBA program director at the t niwrsity 
of Minnesota, found that he was able to identity two signifi- 
cant internal problems that had not previously come to his 
attention, and was then able to take action based on the 
data obtained and make immediate improvements. Ken 
Bardach. MBA program director at Michigan Mate l niversity 
added that "benchmarking force's us to do the things that 
good managers want to do but line! excuses not to ... It 
forces us to put mirrors around us. look at what we’re 
doing, and see if vve re doing it well' (AACSB l l )Ut. p. l“). 
Overall, the participating business schools see benchmarking 
as a critical catalyst for change, and it reduces, or eliminates, 
resistance to improvement because resistors hnd it difficult 
to dispute hard data. 

The success of the pilot study led Pica and Hetrick to form 
a consulting coinpam called Educational Benc hmarking. Inc'. 
([•BI> and then offer to conduct a full study. In the* Pall of 
19 P-I. <>S schools paid M.siin t<» participate* in the* first yeai of 
the* stuck. A id- page summary of the results was delivered 
the following vear. and non hundred invitations were then 
sent for participation in the second year of the* study (Pica 

PBI plans to add a student satisfaction benchmarking 
survey in and it is aho considering benchmarking fac- 

u It v productivity in the future The kind of benchmarking 
that PBI and the business schools are doing lias been highly 
effective, because* it is developed and used by the personnel 
involved in the actual implementation of the processes stud- 
ied. Other benchmarking protects are often initiated .it a 
vetv senior level within a college or university, and the 
results never reach, and or do not have the* ownership (if the 
units responsible, in order to make* effective* improvements. 

ACHE Competitive Benchmarking Study 

In IW\ the Association for Continuing Higher Education 
(ACME) funded a benchmarking project, conducted by the 
author of this report, to measure the administrative process- 
es and financial ratio*' associated with noncrcdii course* and 
program management (Alstete ldnoi. A cover letter and a 
A/Citem questionnaire were mailed to the .^uo institutional 
members of the ACHE in August IWT A follow -up letter 
and second questionnaire were sent one month later to all 
non-respondents. A total of Si surveys (_T percent) were 
returned. ( |q percent) of which were* usable* lor the* pro|- 
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ect. Main of the 33 questions in tin* survey required tl it* 
sometimes laborious computation of ratios and percentages 
ol current administrative activities, and financial ratios for 
non-credit programs. Several respondents commented to 
the researcher that the mere activ ity of calculating these 
ratios and percentages for the survey was of use to them in 
analyzing their administration. The results are intended to 
provide an external perspective on administrative practices, 
identifv best practices, and specif) areas for improvement in 
the reader s noncredil program management. 

Since manv, if not most, noncredit programs offered bv 
offices of continuing education are required to be self-sus- 
taining financially, a key benchmark identified by the partici- 
pants was the financial surplus ratio. This kind of ratio may 
not be a kev indicator lor other departments in colleges or 
universities, but it is mere!) being shown as an example of 
how certain benchmark information was presented to search 
lor best practices in noncredil continuing education. This 
key benchmark measured the percent surplus generated by 
dividing the remaining dollars (after all administrative and 
instructional costs) by the total revenue generated for non- 
credit courses. The average financial surplus generated for 
all participants was found to be 20.<> percent, and a median 
o! I ^ percent. The lop 13 performing institutions on this 
particular benchmark were identified as the "leaders, ' 
because they had a financial surplus of 3b percent or greater. 
As a point of reference, a comparison with the process lead- 
ers is usee! throughout the analysis reported to the partici- 
pants. However, the most important comparison will be w ith 
the participants own institutional benchmarks for process 
improvement ellorts. The differences between the full group 
ol participants and the financial surplus leaders appear in the 
sample process benchmark questions shown in Table b. 

Inquire response lime measured the average number of 
days to mail out a catalog brochure to prospective students 
wh<> inquire. The average response time for all participants 
was S. i days, w ith a median of 2 days. The leaders had an 
average ol i.b da\s and a median of |.(> days. The inquirv- 
to registration conversion ratio showed that, on average, the 
leaders outperformed the entire group of participants in the 
stud) In converting more inquiries into registered students. 
The annual legist rat ions to administrative stall ratio found 
that the financ ial surplus leaders have a lower ratio of staff 
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TABLE 6 

Sample ACHE Competitive Benchmarking Study Results 
(Alstete 1996, p.28) 
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tn students. The percentage <>l new courses offered had a 
higher median (in percent) for the financial leadeis than for 
all study participants < IS percent). This mav suggest that the 
more financialk successful programs try out more new 
courses. Although this data ' s interesting to see how differ- 
ent institutions perform, the real benefits are in how il can 
he user I by participating continuing education administra- 
tors. Information on the processes of all participants can Ik* 
com pa reil with leaders, analyzed for effectiveness, and deci- 
sions can be made if improvement efforts are warranted al 
the home institution. II a participating institution discovers 
an area of a noncrcdil program that is not efficient or overly 
expensive compared to peers, it now has data to attempt 
improvement efforts. Oik* part missing from this bench- 
marking project is the ability to identih and visit competitive 
institutions, as some consortium and most individual bench- 
marking studies offer the participants. 

Consortium Studies 

( >llu*r meth< ids of obtaining hciu hn talking dal a itu hide 
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consortium studies organized by institutions interested in 
lively .sharing information. One of earliest such studies was 
the study of Independent Higher Education in Indiana con- 
ducted in the mid-ISfOs (Jcllema <N Oliver This proj- 

ect was underwritten by the Lily fndowmcnt. and it was 
commissioned by the Associated Colleges of Indiana and the 
Independent Colleges and l imersities of Indiana. Inc., 
whose joint boards acted as a steering committee lor tile 
study. In its year ot operation, the study produced six 
reports on institutional goals, the cost ol instruction, student 
characteristics and finances, financial health, inter-institution- 
al cooperation, and economic impact. Twenty-nine of the 
M independent, four-year accredited institutions in the State 
of Indiana participated in this early example of a competi- 
tive benchmarking-type study. The findings were used for 
comparative purposes to provide each institution with a 
historical benchmark for planning ami making projections. 
Manv (if these goals overlap with the objectives of bench- 
marking. as we define 1 it todav . 

A more recent consortium-sponsored project is currently 
being conducted by the’ l nivet'sity of Delaware National 
Studs of Institutional Hosts and Productivity. ami it is funded 
for three wars by the fund for Improvement of 
Postsecondary P.ducation. The study will survey !(><• institu- 
tions. of which SS arc research, n doctoral -granting, and "S 
are comprehensive colleges and universities (Middaugh 
IWi, Additional data sharing consortia include the Higher 
fducalion Data Sharing Consortium and the Public 
Iniversity Data sharing Consortium (which is no longer 
active), the Southern I niversity Data Sharing Consortium 
(Middaugh Hollow el! IW2>. and the National Cooperative 
Data Share - benchmark Data P.xchange by John Minler 
Associates (Minter IWo). Data sharing consortia such as 
these tan make uniform and consistent inter-institutional 
comparison Icasiblc and cost -el I eel ive. They routinely con- 
duct studies to collect data on academic and administrative 
workloads, stalling and funding patterns, and other variables 
across the spectrum of participating institutions. These con- 
sortia are often organ i/cd by administrators from offices ol 
institutional research, and tliev rout inch organize special 
interest meetings at the annual Association lor Institutional 
Kcseaic hers forum. 

Tlu* National Cooperative Data Share benchmark Data 
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Lxchange is a subscription service currently available on the 
World Wide Web at http: www.edmin.com jma ncds.html. 

Its purpose is to provide timely, relevant, and accessible 
comparative information tor planning and budgeting, but 
could possible be used as a beginning for a true benchmaik- 
ing search tor best practices. An institution wishing to 
examine its revenue contribution ratios, expenditure alloca- 
tion ratios, faculty salary tiles, enrollments, retention, and 
other data can pull the appropriate data from hundreds of 
institutions across the nation (Minter 1W0L 

One discipline-specittc prolcssional association that spon- 
sors data sharing and otters advice tor process improvement 
is the Learning Resources Network through their publication 
titled Ratios for Success" (l.LRN 1 W). This international 
association provides information on class programming and 
consulting expertise to organizations ottering classes toi 
adults, including colleges and univ ersities, public schools, 
hospitals and community groups. The l.LRN association 
states that this publication provides ratios that are intended 
to be "pegs" or "guideposis.” that can be used by program 
administrators to reduce guesswork when planning educa- 
tional programs, forty-two ratios are listed and cover gener- 
al costs, promotion costs, financial ratios, and course 
enrollment calc ulations. The following example for the New 
bourse Cancellation Rates show how the ratios are listed for 
the* l.LRN association members who purchase the report. 

Ratio: New Course Cancellation Rates 

• Definition: A "new" course is one which has not been 
ottered lx* tore. 

• Ideal: .yoott percent of new courses 

• Importance: l nderstanding the course cancellation rates 
for new courses versus the* old successful couises will 
help vou improve your product mix. 

• Lxpla nation: New course's ought to have a higher cancel- 
lation rate than old courses. New courses have not yet 
been offered: you are experimenting, trying new ideas. 

t hus, if your ( >ld Course Cancellation Rate is in the toler- 
able range, vou can tolerate a much higher cancellation 
rate for your new courses .... 

• Related Ratios; See also "Number ol New Courses to 
Offer:" “Number ol Old Courses to Otter: and Old 
Course Cancellation Rale' t l.LRN Ihrti. p. iD 
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The I.KRN organization states that the ratios provided are 
based on 15 years of research into educational programming. 
However, true benchmarking does more than just prov ide 
recommended ratios, it should also uncover the most suc- 
cessful organizations that have the best practices and discov- 
er how they achieve the successful results. The ratios 
provided by Lb R\. although not based entirely on compara- 
tive data, may still be uselul in non-credit program planning. 
The information would be of nint h greater v alue if the rec- 
ommended ratios were more specific, identified the perform- 
ance leaders, and their means of achiev ing success. In 
addition, real benchmarking involves more than just sharing 
data in one industry, it should also include seeking out trulv 
outstanding processes that may be outside higher education, 
and adapting these best practices to the home institution. 

This is w hat many of the individual, institutional benchmark- 
ing projects that will now be reviewed are doing currentlv. 

Individual Benchmarking Projects 

The nonprofit status and decentralized nature of higher edu- 
cation makes it easy to see w hy many colleges and universi- 
ties adapted the aforementioned benchmarking consortia 
arrangements, through professional associations or hiring 
independent consulting companies. However, on their own. 
many colleges have also done internal, competitive, industry, 
and even generic benchmarking as it was originally defined 
in business and industry. In the recent past, colleges and 
universities have on occasion conducted studies and research 
that compare processes, but they leave out the important 
benchmarking goal of adapting best practices. The goal of 
these comparative studies is often to measure cost -effective- 
ness or simply to decide which institution is best, based on 
numbers. One example of an internal benchmarking-like 
study was conducted at the I'niversity of Delaware, where 
internal academic and administrative productiv e ratios and 
cost containment strategies were calculated and compared 
( Middaugh «X; Hollow ell 1992). Staffing and productivity 
ratios were analyzed across departments and used for bud- 
getary planning decisions. The authors reporting on this 
project comment on the potential usefulness of 'inter-institu- 
tional data (competitive benchmarking) to com pate academic 
and administrative workloads. Another example of a pre- 
benchmarking comparative studv was conducted in the ear 
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ly- 1980s by the Suite University ol New York (SUN'Y) at 
Fredonia (Reimann 1995). The study involved comparing 
the effectiveness on student achievement of their General 
College Program (GCP) curriculum with Miami University ol 
Ohio, w hich had no such program, lest achievements horn 
sample student groups from each institution were paired, 
and the results showed a greater maturation rate for 
Fredonia s students compared to Miami's. Again, this is simi- 
lar to competitive benchmarking and shows that there are 
precedents in which institutions of higher education have 
froelv shared data and compared practices. Hven articles 
published this year continue to use the term benchmarking 
when it is marginally appropriate. A study titled 
“Benchmarking Academic Credit and Noncredit Continuing 
Education" (Brewer. Hale, and Mcl.aurin 1999) is a descrip- 
tive survev of organizational structures and administrative 
practices within the University System of Georgia. According 
to the authors, the purpose ol this ini urination is to prepare 
for the next step of benchmarking that will determine the 
reasons behind the differences uncovered in the first study. 

An example of benchmarking that is closer to the true 
definition of the process was conducted at Oregon Stale 
University in the early 1990s as part of its overall effort to 
reshape the university with restructuring and process -reengi- 
neering (Coate 1992). The consultants that OSl hired rec- 
ommended that they should use a peer group list rather than 
an “aspirant group" list of institutions that represent their 
current cohorts, and not models for significant improvement. 
Their goal was to discover problem areas and build up the 
reasoning for radical change. OSl developed a list ol eight 
universities to benchmark: Colorado State. Cornell. Iowa 
State. Kansas State. North Carolina State. Oklahoma State. 
Oregon, anti Washington Slate. At one point, the committee 
conducting the project decided to include at least one “aspi- 
rant" universitv (Cornell), as well as the* other peer group 
institutions. The consultants suggested that the peer institu- 
tions could prov ide the much needed general data to match 
with OSl and universities, such as Cornell, that were best 
in class." These would lx* used for benchmarking some 
indiv idual processes. The benchmarking methodology pro- 
ceeded at OSl when the university president sent a cover 
letter, along with the benchmark survey form, to the* presi- 
dent of eac h universitv in the project. In addition, a tele- 
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phone contact was made and instructions were also sent 
directly to the person who would gather the data and com- 
plete the benchmarking survey form at the participating 
institution. The other universities were very willing to com- 
plete the form, which required significant time and effort, in 
order to receive a copy ol the benchmarking data. A sample 
of the comparative data used in examining processes at OSl 
are shown in the table below: 

TABLE 7 

OSU’s Relative Funding vs. Peer Average, as a Percent 
(Coate 1992, p. 25) 
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The comparative benchmark data proved to be valuable 
reference points for assessing relative efficiency of adminis- 
trative and support sen ices at OSl . They also hoped to use 
the data for gaining ideas for the actual improvement of the 
lunctions, which is the ultimate goal ol benchmarking. 

Individual, institution comparative studies, with the 

































benchmarking label, began in the 1990s. Most ot the exam- 
ples cited in this report were found using the ERIC national 
literature database. However, another good source ot infor- 
mation. and examples of benchmarking in higher education, 
can be found on the Internet, in areas such as the 
Continuous Quality Improvement l.istserv (CQ1-L) Archive 
and other World Wide Web sites (see Appendix (,). I he 
CQI-L computer mailing list is moderated by Steve Brigham 
for the American Association for Higher Education. 

Recently, a series of questions concerning benchmarking 
were posed to participants on the CQ1-L focusing on the 
applicability ot benchmarking to higher education, what 
processes should be benchmarked, examples ot studies 
conducted, and cases where processes were benchmarked 
with organizations outside the field of higher education. 

lattice I )ossey- Terrell at the I'nivcrsity of Central Florida, 
staled that her institution has been benchmarking the lol- 
lowing practices with other organizations: 

• Employee performance evaluation — Xerox. Seminole Cly. 
Schools ( FT). 

• Algebra instruction — various Florida community colleges. 
Cornell. 

• I’ndergrad Graduation Certification and the Student 

II) Access Card — FSC, Drew Cniversity. and several oth- 
ers. 

She relates her experiences with benchmarking as fol- 
lows: 

Thus far. our benchmarking efforts hare been very 
helpful, and hare prerented us front making some deci- 
sions ire would hare regretted in the future. Our 
improrement team is studying trays to improre our 
retention of students in beginning college algebra and 
has been particularly successful in finding and incor- 
porating curriculum design and teaching methods . 
found outsule of l CP into our beginning algebra 
entases here. U e hope to derelop a more structured 
approach to benchmarking daring the next year within 
the Office < fouality Management, so that we may he 
more helpful in that reganl to our quality impmivmcnt 
anti planning teams i Dossey- lerrcll 199S. p. t). 



Other institutions, such as Pennsylvania Stale l niversitv. 
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haw been usim> benchmarking initiatives in a wide variety 
of areas w ithin the l niversity. Louise Sandmeyer ( 1995) 
commented: 

Ibis year all budget executires woe as Led to include in 
their strategic /dans a {dan for benchmarking. 
Administrators tcere asked to include in their /dans a 
determination of what criteria to use in establishing 
benchmark quality indicators, benchmark />rocesses. 
and benchmark unirasifies. colleges, and de/)artments. 
Initially, units hare been asked to collect internal data 
and initiate collection of data from comparable units. 
cum/Htre and analyze internal and external data, and 
discuss im/dications for strategic goals and action 
/dans, ft is ex/ncted that over time, units will examine 
/) roc esses that enable other units to achiece su/)erior 
(>erformance. and units are being encouraged to 
understand the fwocesses and /wactices that make a 
/wogram or department best in class . . . Our TQM 
l-'orum /utrtuer. Dupont, del ire red a benchmarking 
course on campus and hare shared their benchmarking 
materials with us . . . The process improvement model 
Ithatl we are encouraging CQl teams to follow includes 
(t benchmarking ste/K and many of our teams hare 
benchmarked their processes . . . ds part of CQl train- 
ing. ad hour introduction to benchmarking course is 
regularly offered through the Human Resource 
Derelo/mtenl Center. When rerietriug the benchmark- 
ing section of the strategic {dans, we found that there is 
considerable c*>m/)aralire analysis going on. Some 
units hare begun to identify core / processes and are 
establishing benchmarking assessment teams IV c* con- 
tinue to />n fit from our cor/)orate part nets who kee/t us 
on track and em/thasize the im/xtrlance of benchmark- 
ing /)mcf‘sses for impnnvment. and not fust the collec- 
tion of data to /wore how good we are ( p. i ). 

( )ther colleges, such as Bahson College, have locused their 
individual institutional benchmarking ellorls primarilv on the 
business transactions processes, (ierrv Shaw ( 1995) front 
Bahson summarized their etlorts. which, like Pennsylvania 
State* l 'niversity above, involve real generic benchmaiking 
and st *arches lor best practices outside ol higher education: 



One of the processes inrolred here is the registration 
process. Recognizing that this process has a number of 
sub-processes. benchmarking in this area has taken on 
ciirerse areas. So far. ire hare met irith represen tat ires 
from hotels (around the registration and check-in 
process ). Disney ( around the technology and "smart 
card "), banks, and a fete other organizations (around 
the hilling process), (,'hrylser Corp. (around the cus- 
tomer focus area), a Big Six accounting firm (around 
the technology they use for the recruiting process), and 
other institutions of higher education (irho hare 
already begun to do what ire are aiming to do). U c 
hare not gained much from the SACl BO study. V he 
benchmarking work ( ire hare done) has helped us a 
great deal. We hare learned where and what to arm'd 
as ire more along how others hare dealt irith resis- 
tance along the way. how technology can be used to 
better enable what ire are trying to do. and how to 
achiere a stronger customer focus. \\ e bare found the 
rations companies ire hare contacted to be eery inter- 
ested in what we are doing and rery open and willing 
to help us (p. l-SL 

Benchmarking does not have to lx* complex or very high- 
ly structured in order to he elfective. One simple project 
was conducted at the Cniversity ol Chicago's Graduate 
School of Business (Bateman 199 1). An internal Benchmark 
ing project involving management education was done By 
tlx* MBA students in an ellort to improv e teaching. 1 he 
students ranked each faculty member's teaching and 
described whv there were differences. Speaking at a recent 
AACSB Continuous Improvement Conference. Ceorge 
Bateman from the School ol Business staled that the results 
were surprisingly well-received, lie Believes that adminis- 
trative and academic quality efforts are inextricably linked, 
and stated that if a college or university is applying quality 
only to the administration side, they are missing a lot. 
Academic and administration need to Be linked in quality 
improvement el Ions. 

Cetio Sclmell from the Office of Continuous Quality 
Improvement at the l niversity of Maryland, reported that 
Benchmarking has Been used suw esslullv to reduce the 
processing tin* * for surplus property requests: 




Benchmarking 
does not have 
to he complex 
or very highly 
structured in 
order to be 
effective. 
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When the need for a new snip! us property process 
ei rose, the Department of Procurement and Supply cre- 
ated a CQI action to study how campus departments 
could he serred better. I p to that point, departments 
with excess equipment or furniture were required to 
keep the property in their departments, until a new 
owner could he identified with hi. or outside, the 
t 'niversity. On average, it took more than 74 days to 
/woe ess a surplus property request. The team seized 
upon the construction of a new central distribution 
facility on campus and designed a surplus operation 
. . . Xou\ when departments determine that they hare 
un needed property, they can schedule an immediate 
pick up. As soon as it unites ... it is available for pur- 
chase rather than awaiting an annual surplus property 
auction. The team designed this operation using con- 
tinuous feedback from campus customers and bench- 
marking to hS other surplus property operations in the 
l .S. and Canada ( 1995, p. 0). 

Benchmarking in higher education is also being conduct- 
ed at several European institutions, hot example, the gradu- 
ate business school benchmarking efforts discussed earliei 
ha\e been applied to Kuropean management schools 
(Detrick et al. 199 t: Detrick cS; Pica 1995). Also. Art Clarke 
from Sir Sanford Fleming College stated that benchmarking 
is being used as part of an overall quality improvement and 
competitive analysis program at his institution: 

The notion of benchmarks, while not new. has not been 
considered in earnest until recently. Croivth iras 
encouraged and funded. In this heady, expansive 
atmosphere the established standards were broad and 
general, making them easy to achieve. Additionally, 
while the colleges are hounded by a variety of legislated 
requirements, within these, each college is fiercely 
autonomous. Ho iv times have changed! Many factors 
hate joined to decrease the rate of increase in the fund- 
ing that the colleges receive from the province, hi fact 
this war. the colleges had to return .■>'■/> of their grants. 
‘Competitiveness. " in the sense that the private sector 
uses it. is now part of how the public sector must oper- 
ate. Thus /there is l the interest in partnerships and joint 




ventures. program rationalization. TQM. CQI . stand- 
arris, anil Ixnichmarks. Our ministry publishes data 
comparing the colleges on a variety of expenditures: full 
and part-time faculty, administrative costs, professional 
development expenditures, and so forth. An analysis of 
faculty workloads across the system has been completed. 
While benchmarks are implied in this data, the effort to 
establish them has just begun. Fleming has only begun 
the process of arriving at benchmarks. The Board of 
(lover us ami the Senior Management Team have done 
some work to identify performance indicators. 

Benchmarks will be developed front these. \\ e are 
uncertain whether to use internal criteria or external 
criteria such as other colleges, government departments, 
nr private sectors organizations ( IW. p. s). 

( )thcr owsca.s benchmarking studio* include a project in 
the Department of Counseling and Health at Queensland 
I'niversitv of Technology. Australia (Jackson B)9s>. They 
are working w i t h a benchmarking team from the internation- 
al student sen ices section and Careers and Kmploymeni 
Services office. The goal is to benchmark processes used 
for translating client input into sen ice requirements and use 
these requirements for services planning and implementa- 
tion. This will be accomplished using quantitative question- 
naires and qualitative research from locus groups. Although 
the first stage is a noncompetitive internal benchmarking 
project, it will lead to comparative external benchmarking 
activ ities, as well. 

Harvard business School has also used benchmarking to 
improv e the delivery of their prominent graduate business 
programs, faculty members actively visited nearly two 
dozen traditional business schools in the l nited Stales and 
abroad, as well as corporate training programs, and other 
selected institutions to collect information. Harvard wanted 
to compare itself to its competitors, and use the data to pro- 
vide a better MBA program. The "Kxternal Comparisons 
Project learn was influenced by the extent of dramatic 
change that is occurring in business schools they visited, and 
concluded that MBA programs are redefining the nature of 
management education tflBS l ( ) l H>. The report that resulted 
from this project use's text and figures to compare the cur- 
riculum of traditional MBA programs with the new designs 
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they found. The Harvard ease is an example of benchmark- 
ing clone by and for faculty in higher education. 



In some colleges and universities, benchmarking and 
quality concepts have been accepted and used by both fac- 
ulty and administration to help convert the institutions into 
true learning organizations. Several institutions of higher 
education have used the concepts and criteria of the 
Malcolm Baldrige National Quality Award (MBNQA) in their 
planning processes and outcomes measurements (Seymour 
1096). Continuous quality improvement and the use of real 
benchmarking 'techniques to search for best practices are an 
integral part of the Baldrige Criteria, along w ith an overall 
goal of continuous organizational learning. As stated earlier 
in this report, the MBNQA c riteria was adapted for education 
(see Appendix A), and a full MBNQA Pilot Study was con- 
ducted in 199s at Northwest Missouri State I niversiiy. A 
“Culture of Quality." originated at Norlhwe-t Missouri State 
in the micl-19H0s. incorporates a systematic search for best 
practice ideas to enhance administrative efficiency in the 
I'nivcrsity. 'Phis process started in the administrative areas 
and grew to improv ing undergraduate education, and the 
overall quality of the university. After implementing many 
best practice ideas and benefiting greatly from these bench- 
marking and qualitv improvement efforts, the planners at 
Northwest Missouri State Cniversity concluded that a simple 
repeat o! iheir search for best practices would not be as 
beneficial as it was the first time. They considered several 
options and decided to use the MBNQA as a template* for 
continuous quality improvement. 

The education-adapted MBNQA criteria, as implemented 
a* Northwest Missouri State I'niversity. uses external com- 
panions. benchmarking, and the search for best practices 
throughout the seven categories used for scoring: leadership, 
information and analysis, strategic and operation planning, 
human resource development and management, educational 
and business process management, institutional performance 
results, student focus and student and stakeholder satisfac - 
tion (Ncvmour 1990). for example, in the leadership catego- 
ry l.l (senior administrate e leadership, worth to points), 
real benc hmarking c an be seen: 

Aoainsi the haehumund < fa focused mission and chal- 
lenging megatrends, faculty, staff, ami students uvre 




asked to identify 'host practices " through a benchmark- 
ing process. A* part of the process, faculty teams 
reviewed cd! available recent literature, along with the 
so-called "reform literature" relating to undergraduate 
education. Additionally, the nation 's best known lead- 
ers in higher education were contacted for their best 
practice ideas. At the end of the process, over 200 best 
practice ideas were identified and cataloged (Seymour 
19%. vol. 2, p. .36). 

Northwest Missouri State I'niversity tlkl more than just 
use external data comparisons, as many other institutions do 
when conducting "benchmarking." They searched lor best 
practices and implemented the findings across the t niversity 
in many different departments and areas ol measurement, 
including strategic and operational planning (category 3 )■ In 
addition, benchmarking is actually the primary focus in the 
second category 2.2 - Comparisons and Benchmarking. The 
description of this category details how comparisons and 
benchmarking data are selected and used to help drive 
improvement of overall performance, how needs and priori- 
ties are determined, criteria for seeking appropriate informa- 
tion and data, how the information and data are used to set 
improv ement targets, and or encourage breakthrough 
approaches, and fmallv how Northwest evaluates and 
improves its overaii benchmarking process (Seymour 1999). 
Of all the individual institutions using benchmarking. 
Northwest Missouri State I 'niversity's pursuit of the MBNQA 
is perhaps the most thorough application ol benchmarking 
in higher education uncovered for this report. 

Benefits and Concerns for Higher Education 

In most of the cases where benchmarking was conducted, 
positive comments were made about benchmarking activi- 
ties at colleges and universities, and that external pressures 
for the use* of benchmarking could help speed implementa- 
tion. Kav Carlson, from Dalhousie I'niversity. believes that 
benchmarking is a much needl’d comparative analysis tech- 
nique. and he described the* future plans lor benchmarking 
at his institution: 

I ron t mv perspei tire, benchmarking is probably the key 
to (.(Jl being useful on campus. At the same tune. 
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benchmarking relies on some form of outcome meas- 
urement — as one can measure outcomes in a valid and 
reliable tray, it becomes possible to i( lent if \ • processes 
that seem more effective, and then tty to isolate factors 
that might he responsible , and test whether introduction 
of these factors leads to better results, hi this perspec- 
tive. readiness for benchmarking is basically an issue of 
readiness to directly assess outcome. In the long-run. 
tee hope to include all facets of our operations, hut at 
the moment, this means the best results relate to those 
facets that hat e easily assessable results: e.g.. registra- 
tion activities assessed in relation to time required and 
number of unsuccessful requests, time required in pur- 
chasing books, success in getting access to a computer, 
use o f CD-ROMs, application for research funding to 
different sources, annual fund campaigns, (and! attend- 
ance at various events. It is important, though, to move 
this to the academic and knowledge-product ion facets 
of our operations. Currently, ice can use our existing 
course evaluation procedures to look at best practices in 
terms of generating student satisfaction, as long as we 
isolate comparable academic activities, e.g.. courses 
that are similar in size, pressure to enroll, and general 
content. We have tentatively decided to experiment 
with assessment devices, that might allow comparisons, 
in terms of student learning, for certain types of courses 
and knowledge pay-off for certain types of research, but 
such activities are still in the discussion stage. We are 
likely to move faster when there is external pressure for 
such benchmarking ( 1995. p. 7). 

However. external pressures can also work against a col- 
lege or university. When the benchmarking process is initi- 
ated by departments, such as a school of business or a 
purchasing office, it is clear what the goals of the project are 
and what benefits can be expected by the participants. It 
was also stated earlier that benchmarking is often used inap- 
propriately or misdelined and can sometimes be used for 
purposes other than finding best practices. Dave Sill, from 
Southern Illinois I niversily. related how the term bench- 
marking was used by the Illinois Board ol Higher Mducation 
for purposes other than its definition originally intended 
< l ( )95). The Stale of Illinois Board of Higher Bducation 
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developed a benchmarking process which they tilled 
Priority-Quality -bn iductiv ity (P-Q-PK beginning in 1992. 
Tweniv-live guidelines were to be considered in making 
products it\ improvements in five areas: instruction, research 
and public service, overall academic functions, administra- 
tive functions, and state policies affecting higher education. 
However, the P-Q-P process as it relates to benchmarking 
does not contain a systematic search tor best practices as 
real benchmarking does. Those individuals at the state lev- 
el in charge of setting the benchmarks, are external and 
removed from the units in the colleges and universities 
being benchmarked, .sill < 199 s *) stated that . . because ol 
a lack of familiarity with operations in the altecled units, 
thee have set benchmarks that are arbitrary and in some 
cases liighlv distorted. There is no local ownership ol the 
process" t 1991 p. b ). 

The literature rev iewed often stales that local ownership 
is critical lor success of a quality improvement process such 
as benchmarking, but many colleges and universities have 
continued to receive external prodding for process improve- 
ment. and some have had successful results. Another exam- 
ple of state-mandated quality improvements that involved 
benchmarking was at Oregon State I 'niversity in the early 
IWOs t Coate 1992: Coate 1993). OSl' began implementing 
total quality management in late 19S9 in response to state- 
mandated administrative cost structure assessment, that 
sought to increase effectiveness, elticiency. and reduce 
costs, benchmarking was one ol the many TQM tools used, 
which included organizational restructuring, process reengi- 
neering. outsourcing and elimination, and elimination ol 
unnecessary bureaucracy. 1 he presidents IQM team at 
( )Sl started the benchmarking component by asking 9 
alumni, students, faculty members, business people and 
others, w hat areas needed improvement. I he issues or 
processes of top importance were found to be: admission, 
recruiting marketing, administrative communication, and to 
a lesser extent, the development olfice (Coate 1993). I he 
team decided that their benchmarking effort should have the 
primary goal of improv ing the recruiting marketing process 
of the university and improve the responsiveness of the 
admission process. < )St \ president then established live 
separate TQM teams to study the following major customer 
pri thlems: 
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1. Admissions paperwork and telephone processes. 

2. Graduate admissions process, with the Graduate School 

Office. 

3- Admissions evaluation criteria and process. 

Recruiting and marketing, w ith admission and I'niversity 

Relations. 

S. Admission post -acceptance process, with the Alumni 

( )fl ice. 

As part ol the project, the TQM team analyzed the paper- 
work and telephone process by examining 100 admission 
files at random. They were disappointed at the average 
length of turnaround time they found for processing docu- 
ments. especially compared to that found at the I'niversitv 
of Oregon, a comparable institution. The team then con- 
ducted a data collection tour at the I'niversity of Oregon, 
gathering information on people, equipment, and processes 
that deal with reception and phones, incoming and outgoing 
mail, coding and processing of applications, and ev aluation 
ol applications. The "best practices." as correctly defined by 
benchmarking, were discove red to be the* assemble line 
system that could be adapted back to OSl' and solve their 
timeliness problem. The team leader reported. 
"Benchmarking saved us a year of time . . . [The I'niversitv 
<>ll Oregon was a year ahead of us implementing a new 
software system . . . Our paper flow was still patterned after 
the old system, and it wasn't working" (Goate 1993. p. 29). 

In order to monitor improvements, the team plans to puli 
1 (, () files periodically and chart the turnaround time for pro- 
cessing. Other processes were also improved in this bench- 
marking project, such as the phone answering. These* 
state-mandated quality improvement and cost reduction 
requirements actually created some fans of TQM and bench- 
marking at OSl'. However, most practitioners would agree 
that, if there is local ownership of the process improvement 
techniques, then there is a much higher likelihood for suc- 
cessful implementation and adaption of best practices. 
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We have seen how benchmarking was developed in die 
business world and how it is used today in a variety ol col- 
leges and universities. But where does a reader interested 
in setting up the process improvement technique called 
• benchmarking ’ begin? Many of the books and articles on 
the topic hav e the starting process well-defined. Although 
benchmarking is not difficult, a great amount of thought, 
internal study, and research must be conducted before 
embarking on a benchmarking effort (Brigham 199s). In 
Belmont L niversity's Quality Team Manual on Benchmark- 
ing ( 1993). seven points are listed for consideration before 
beginning to benchmark and are paraphrased as follows: 

l. Is there alreadv a focus in your work area or department 
around serv ice, employees, and continuous improvement 
of processes? 

Z. Is benchmarking the right strategy in this situation? 

( According to the International Quality Study, world-class 
benchmarking is only suitable for already high-perform- 
ing organizations. Competitive or peer benchmarking is 
more appropriate lor low or medium performing organi- 
zations. ) 

A W hat should you benchmark? Choose those processes 
that align with the organizational mission and contribute 
to the organization's long-term success, 
i. What should you measure? You are attempting to gener- 
ate comparative performance data: you are observ ing 
how they achieved those results. 

S. What organization! s ) should you benchmark:' I he ideal 
one would have a higher performance level than you do 
in the specific area being benchmarked. 

(>. How should you collect data? First, establish internal 
baseline performance measures. Then be creative for 
tracking down other sources of data. 

| low can you implement what you learned? Determine 
the variances between vour processes and those bench- 
marked. Separate out. if necessary, unique factors either 
to the benchmarked organi/ation or to higher education. 
Then, develop a mission statement for the process, and 
set dear goals and action plaiiv 

Belmont Iniversity’s seven points are sound, and they 
reflect the original definition and intent of benchmarking. 
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Benchmarking efforts that arc undertaken too quickly, or 
conducted in a top-down approach from the senior adminis- 
tration level, with little or no input from mid-level users of 
the data, often do not realize how important it is to properly 
plan what to benchmark, against whom, how to collect the 
data, and how to analyze and use the results. However, one 
important element missing is the selection of who in the 
college or university w ill actually conduct the benchmarking 
project. Most of the literature reviewed recommends the 
creation of a benchmarking team, especially if the bench- 
marking project is not to be primarily conducted by a pro- 
lesMonal association or daia-sharing consortium. 

Spcndolini ( 1992) staled that there are indeed some 
explicit qualifications lor benchmarking team members that 
should be considered before beginning (Ik* project. Some 
colleges and universities may be restricted by size in the 
choices they can make, but it is still wise to consider these 
attributes, and therefore, maximize the effectiveness of the 
team (or committee ) choices that are available. The first 
specific characteristic recommended is functional expertise 
and a demonstrated level of job skills, or work-related 
performance, in the position they hold at the institution. 
Second, the employee should have sufficient credibility in 
the institution, as judged by subject-matter knowledge, 
employment history, and the level of position* s) held, 
benchmarking team members should also have above aver- 
age communication skills, in order to communicate well 
with other team members and the benchmark project part- 
ners at other organizations. Lastly, Spcndolini recommend- 
ed that ellcctivc benehmarkers need to have a high level of 
team spirit, including a sense of cooperation, effectiv e listen- 
ing skills, an ability to reach a consensus, and respect for the 
opinions of others. Dale ( 199s) added that the "perfect “ 
team member w ill be implementing changes, is hands-on. 
action oriented, has nothing else to do. is a super salesper- 
son. and is creative and flexible. The optimal team size, 
according to Dale, is five members, who are from multiple 
disciplines and personalities. Once the team is selected, the 
next step should be the selection ol the topic(s) for the 
benchmarking study. 

Deciding What to Benchmark 

Process benchmarking studies analv/c the processes or prac- 



tices th.it a iv important to the performance ot the organiza- 
tion (A1\)C P>M). The catalw tor the study may be identi- 
fied front institutional problem areas uncovered, internal or 
external strategic change initiatives, or the currently popular 
continuous quality improvement etlorts. A basic lesson 
learned in the quality movement relates to processes and the 
Pareto Principle, which states that 20 percent ot all activity 
affects So percent ot the results (Watson, PW>. Theretore. 
the locus of improvement el forts should be on those tew 
critical processes that have the highest potential for ' return 
on attention." as Watson labeled it. Processes are often cho- 
sen to be benchmarked because they have a broader range 
than business practices, and are important for achieving criti- 
cal success factors ( .WQC 1WI. The American Productivity 
and Qualitv Comer defines these terms for business and 
other organi/auons. and the definitions have been expanded 
to irk hide examples of their use in higher education: 

• business /)rocesses are logical combinations ol people, 
equipment, materials, and methods that (are) organized 
into work activities to produce a given tun put. These 
activities have varving levels ol scope. The underlying 
principles of TC V )M include the concept that organizations 
basicallv consist of a set of interrelated processes, nested 
w ithin each other, l or colleges and univ ersities, these 
processes include the broad administration of the college, 
within the supervision process of academic departments, 
and which include the actual process of course instruction. 

• (. ritii. a f success factors < CM s > are those characteristics, 
conditions, or variables that have a direct influence on a 
customer's satisfaction with specific business processes! 
and therefore, on the* success of the entire process, P.x- 
amples of (ISPs for higher education include regional and 
professional accreditations, student evaluations, competi- 
tive rankings, graduation and placement rates, service 
levels, etc. 

• business practices are methods, or approaches, that facili- 
tate the execution of a process, for example, the self- 
study for accreditation is a process lor colleges and 
universities. The business pi ac lice is to base the criteria 
joi self-stuclv on the regional accrediting bodv or proles- 
sional association's ciitena for self -assessment (adapted 
(torn \IH H l l W. PP-^-'p 




. . . the focus of 
improvement 
efforts should 
be on those few 
critical pro- 
cesses that 
have the high- 
est potential 
for return on 
attention ” . . . 
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In order to help guide Ixmchmarking teams, to link the 
processes to be analyzed, with important critical success 
{‘actors. Spendolini < 1992) stated that Xerox asks employees 
to consider the following 1 () questions: 

/. \\ hat is the most critical factor to my function organiza- 
tion's success te.g.. customer satisfaction, expense to rev- 
enue ratio, return on asset performance )'? 

2. What factors are causing the ntost trouble <e.g.. not per- 
forming to expectations)'' 

W hat products or services are provided to customers' 

d. What factors account for customer satisfaction' 

5. What specific problems ( operational ) have been identified 
in the organization' 

(). \\ here are the comf c f it ive pressures being felt in the orga- 
nization’' 

What are the major costs for cost "drivers ") in the organi- 
zation' 

<S\ Which functions represent the highest percentage of cost? 

9. Which functions have the greatest room Jbr improvement ? 
K). Which functions have the greatest effect < or potential ) for 
differentiating the organization from competitors in the 
nuirketfrfacel'ip. ~ 1 ) 

These questions help the benchmarking participants pri- 
oritize the potential benchmarking processes based on need. 
The main locus of these questions are on cost reduction, 
problem reduction, customer satisfaction, continuous im- 
provement, and marketplace superiority, each of w hich 
could accurately be defined as a critical success factor. 
Additional ad\ice includes the benchmarking SMART 
acronym, which means that the* processes are Specific. 
Measurable. Achievable. Realistic, and Timefranied (Dale 
199s). 

II an organization is conducting benchmarking because a 
problem has already been uncovered, on a process or busi- 
ness practice (problem-based benchmarking), then the iden- 
tification of w hat to benchmark should not be difficult. If. 
however, an institution is not immediately sure where to 
begin, then deciding w hat processes to benchmark must be 
planned thoroughly (process-based benchmarking). 
I'arlicipants in organized benchmarking studies, such as 
\ \(!l B( ). can choose from more than 29 institutional areas 



and processor to analyze, or benchmark them all (see 
Table «S) 



TABLE 8 

Functional Areas in the NACUBO National 
Benchmarking Survey (NACUBO 1995, p. 39). 



(~<>re functional Areas 



l. 


Academic Aft airs 


in.Info Technology ’Telecomm.* 


> 


Accounts Payable* 


1”. Bay roll 


3. 


Admissions 


IS. Purchasing 


t 


Alumni Relations 


19. Registration and Records* 


s. 


B« h >kstc >iv* 


in. Risk Management* 


0. 


Central Budget Department 


2 1 . spi mst >red Pr< >jecls* 


— 


Collections* 


22. Student Accounts Receivable* 


,s. 


Development < H'fice 


23- Student Health Services 


o. 


facilities* 


2 i. Student 1 lousing 


Hi. 


Financial Md* 


2s. Treasury -Cash Management 


11. 


food Services 


2n ( herall Indicators and Ratios 


12. 


(ieneral \o minting* 




13. 


Human Resources — 


< )jstion.il Sections 




(ieneral 


1 Multi-Campus Sy stem 


! t. 


1 luman Kesouix es — 


Administration 




Benefits Administrate >n 


2 Data for Institutions with 


Is. 


1 luman Kesi mrces — 1 linng 


1 lospitab 



* sur\e\ sections lli.it weie lOK'wal and refilled m I A PO(. l'\ l‘> l U. i >i 

Pi I9 »>s 

The benchmarking project conducted tor the Association 
for Continuing Higher Education (ACHE) primarily measured 
administrative processes, including noncredit course promo- 
tion. adv ertising, student recruitment, financial ratios on 
facultv and stall salaries, and the use ol inlormation technol- 
< >gy ( Alstete 

If a college or university clues not plan to participate in 
the NACl'hO. or other association benchmarking projects, 
or if tile desire lor benchmarking is coming from an institu- 
tion or academic unit on campus that does not have the 
option for an existing study, then a new benchmarking plan 
will be needed, (.lamp ( I9S9) recommended that the best 
place to start is at a high strategic levei and then cascade 
down to an individual, deliverable level. Ihe mission state- 
ment of the organization is a good place to identity candi- 
dates lor benchmarking Irom a strategic point ot v ievv . and 
the mission statement of the individual units within the orga 
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ni/ation van Ik* useful as well. Mission statement* usually 
identify customers. products and services, critical success 
fat. tors, processes used, and more. The college or university 
mission statements often have very general descriptions of 
their objectives. lor higher education, the unit level mission 
statements, such as those written b\ individual schools or 
departments, may be a good place to start. 

Recipients of the C( v )l-1. computer mailing list w ere recent- 
ly asked to list activities, tasks, and subpmcesscs that they 
believed are worthy of being benchmarked (Brigham. 199s). 
Kay Carlson ( ! ( Wsi from Dalhousie I'niversity stated that 
course delivery methods that reduce cost, but maintain or 
increase learning, should have the highest priority in bench- 
marking efforts: administrative processes such as registration 
and student advisement activities should receive lower prior- 
ity. Contrarv to that perception. Art Clarke from Sir Sandford 
Fleming College stated that administrative functions such as 
recruiting and registering students, although difficult, should 
receive top benchmarking priority. Other responses on what 
to benchmark include comments from a variety of different 
department units, with different perspectives on what pro- 
cesses are important. A sample of some ol the other "wish 
lists" for benchmarking in higher education are as follows; 
Louise M. Hies. Brigham Young I'niversity 

U e are in the taiufuc position as a university of nut 
uectiiug to recruit students: rather, ire a re forced to 
turn diray thousands each rear due ftof the nature of 
uitr being a church school Our problems mar there- 
fore he .s lightly different than ollh'rs. \\ e are most inter- 
ested in academic. n<>I administrative benchmarking. 

I he areas of highest interest for benchmarking are as 
follows fisted by priority- ileucra! Pd curriculum. Time- 
la gradualism . "Major' hours reifinrements. (trading 
prac lues i oiiutenng grade inflation, and Peer evalua- 
tion t I UOs, pp. i- ( ) 

Brike Mark. Colorado Mate I'niversitv 



/ ( Juahly of education re t en ed — lire you able to use ivhat 
was taught' 

J Pen entage tf students that get a fob in their jic/d within 
six months <f graduation 
.1 Diversity 
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1. Quality of incoming freshmen diPAt 
■>. Retention rates 

b. Percentage that graduate in four years fire yea is ( 1998. 
P-3). 

Joyce Albin. I'niversity of Oregon 

/ trill >/>eak strictly for my department — which is primarily 
a research and derelopment unit, caul secondarily a teach- 
ing tout . . . 

Appropriate processes that we could benchmark * might 
include. 

• Derelopment of proposals being submitted to federal agen- 
cies and foundations 

• Derelopment submission of articles to he published in 
refereed and non refereed journals . . . 

• Process for finding and latching RI P's that may be of 
interest 

• Process for eifuipment purchase decisions . . ( 199s. p. s). 

The disadvantage of benchmarking at the departmental, or 
"grassroots" level, is that the team, or committee of employ- 
ees conducting the benchmarking, may not he able to gain 
admittance to the world-class organizations needed tor indus- 
try or generic benchmarking (Watson 1992). Therefore, for 
maximum effectiveness benchmarking, efforts should be pro- 
moted and supported by senior level administrators, and con- 
ducted bv, and for. the departmental units that will make the 
most use of the information. It was the president of Oregon 
State t'niversiiy who identified his principal customers and 
the services to be provided to each customer group. I he 
key. critical processes identified are listed in l able 9. 

These are processes identified as critical to OSl . Some 
colleges and universities have already identified important 
processes and have a reporting system in place that uses 
key. success indices, such as the I Diversity of Miami (Sapp 
ex Tenures 1992). bach month, the director of planning and 
institutional research .it Miami makes a presentation to 
senior administrators on 129 indices, obtained from lb 
offices throughout the university. This system is currently 
used to alert seniot management it) problem areas and to 
stimulate discussion about kev sets of university information 
The information collected and presented at the f 'niversity of 
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TABU’ 9 

OSU’s 12 Critical Processes 
(Coatc 1993, p. 10) 



Process 


Performance Measure 


t. rnrollmeni management 


Concordance with 
enrollment management 
plan 


1 . Curriculum development 


Peer acceptance 


s. Teaching 


Student teaching evaluation 


i. International development 


- <>f students going overseas 


s Research 


\umhcr of publications 


(>. Service dclivety (extension) 
p:micipati< >n 


"•< of conummitv 


Community relations 


Number of complaints 


* Information services 


Computer-student ratio 


l > Long range planning 


objectives met 


l<>. Workforce hiring, development 


first choice hires 


1 1 . l ac ihties development 


of value to monev for 
repairs 


1- f unding development 


“s obtained $ requested 



Miami's monthly meetings could also lv used as a basis for 
an internal or competitive benchmarking process. Higher 
education has basic business processes similar to other orga- 
nizations in the corporate world that can be benchmarked, 
and many other practices, w hich are somewhat unique to 
higher education. Potential benchmarking topics should be 
specific, in terms of discovering a competitive advantage, 
identifying the "customer.'' and should be interesting to oth- 
ers. as well. After deciding which activities to study, a blend 
o| internal, competitive, industry, and generic benchmarking 
will probable be needed because of the diversity of process- 
es found in colleges and universities. 

Whom to Benchmark 

We have seen that it is first necessary to decide what process 
or processes to benchmark. Once this is done, it then needs 
to be decided if it is necessary to seek the "best of the best" 
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with generic benchmarking. or it it is more advantageous to 
seek a pan tier that is considered a ''performance success' in 
an analogous process (Watson 1W3P for institutions that 
are novices with benchmarking, it is recommended that 
more "grassroots level studies be conducted, which meas- 
ure departmental or administrative unit processes internally, 
or with local external competitors (Marchese IW^b). Same 
speed partnerships tend to return the highest value, and 
projects often fail when institutions reach for "too much, loo 
soon.” However, institutions that are more advanced in 
using qualitv improvement techniques will be able to gel 
more out of benchmarking with "world-class" competitors. 

No matter which type ol benchmarking is going to be con- 
ducted. choices have to be made about which colleges, 
universities, or other organizations are to be bench market I 
against. 

There is a proven methodology suggested by Robert 
O m p ( I dps), which seeks to identity other institutions that 
might become benchmarking partners, because they utilize 
superior processes that use best practices which could be 
adapted. The overall methodology for determining with 
whom to benchmark is to: 

1. Develop a candidate list using any and all readily avail- 
able information and some preliminary research. 

1 . Reduce the list to a target number of organizations 

through secondary research focused on the organization 
and function 

3 . Prepare for a contact with the target organization and set 
up a v isit. 

Suggested places to begin searching for candidates 
include personal contacts, newspapers, magazines, journals, 
professional associations, benchmarking consultants, and the 
Internet. Organizations such as the American Productivity 
and Quality Center ( APQC) in Houston. Texas, founded by 
companies such as AT&T. IBM. and Xerox, oiler a variety <>! 
services to begin a benchmatking process, including a data- 
base of information on best practices horn hundreds ol com- 
panies. In addition, the APQC is planning a project in tin* 
near future focusing on higher education (Wilson 
Ithaca College and the l diversity ol Wisconsin have joined 
The Benc hmarking l.xchange (TBI’i to obtain benchmarking 
partners. TBP. a California-based operation, and available 
via the World Wide* Web. is an open service tor those who 
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wish to become members: participants do not have to join 
am association or special interest group in order take pan 
(TUB 1995). TB1- offers a very comprehensive and user- 
friendly. electronic communication and information system 
designed for use hy individuals and organizations involved 
in benchmarking anti process improvement. Participants 
can see w hat other organizations have done to launch their 
benchmarking programs, solicit help from others, contact 
organizations with whom to conduct a study, or even form a 
group w ith member organizations to share in a consortium- 
type study. The Benchmarking Hxchange and The Best 
Practice Club — based in Bedford. I K. recently announced a 
strategic partnership to create a global, one-stop, on-line 
inlormation and communication network dedicated to facili- 
tating benchmarking and business excellence (TBC 1995). 
Additional resources for locating benchmarking partners are 
listed in Appendix C 

When contacting prospective benchmarking partners, it is 
suggested that the first communication consist of a very 
c lear, short statement of what processes are to lx* bench- 
marked (Dale 1995). The benchmarker should demonstrate 
a clear understanding of what data is willing to be shared, 
and the opportunity and w illingness to establish and main- 
tain an ongoing dialog. The institution soliciting the bench- 
marking information should also have well selected and 
trained participants, and a good knowledge of the prospec- 
tive benchmarking partner. One of the most valuable 
aspec ts of a benchmarking project, in addition to obtaining 
valuable information, is the creation of a new communica- 
tion network between the organizations. Much of this com- 
munication may be somewhat informal, between mid-level 
managers w ho can contact each other when needed. It is 
this kind of communication in which best practices can be 
discus«sc*d. processes can be improved, and v aluable* inter- 
organi/ational relationships nurtured. 



Data Collection 

Once organizations have been chosen to analyze and bench- 
mark. the data collection can begin. The data can be gath- 
ered internally, externally, or through original research. 

Most benchmarking data collection begins with internal data 
collection, then proceeds to public Iv available secondary 
source* data, and finally to competitive benchmarking with 




external institutions. Table 10 lists potential data and infor- 
mation sources for higher education based on the following 
three categories. 

Internal information can be obtained from a variety of 
sources, and has been shown to be productive, because it is 
cost-effective and can uncover additional leads to pursue. A 
product or service analysis of the process at another college 
or university is a good first step. Ordering a catalog or 
brochure, requesting information, and analyzing what is 
receiv ed can rev eal valuable customer assistance informa- 
tion. Another place to uncover data about the organization 

TABLE 10 



Information Sources 
(Adapted from Camp 1989) 



Source 



Internal 



Library data bases 



Internal rc-\ ievv s 



Internal publications 



External 



Ptt >lc*s.sii >na I ass< >ciat ions 



Inclusirv publications 



Special industry reports 



Tunetional trade publications 



General management 



Seminars 



Industry data linns 



Software hardware vendors 



Advertisements 



New -.letters 



Original Research 



Customer feedback 



Telephone Mirvevs 



Inquirv service 



Networks 



Consulting I tints 



Example 



AH information 



Internal experts 



Varies hv organi/ation 



AAIIT. ACIIK. VAl l\ NACl HO 



Chronicle* of Higher Keltic.. 
Change 



Chronicle's Almanac 



Learning Resources Network 



Journal of Higher h. Incut ion 



Hy professional interest 



AI\)C. THE 



SCT. TRC. 



Hy product ol interest 



Hv subject matter 



I' < Mis glOlips 



Specific design 



spec ilk c ontrac ( 



Klee ire »nic. internal, .mil 
external 



rcluc.ttion.il Hcnclim. ukmg Inc. 
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being studied is often inside the home institution. At first, it 
may seem unlikely that the college or university interested in 
obtaining the data may already have some useful informa- 
tion. Frequently, employees are keen observers of other 
organizations, or may even have been prcviouslv emploved 
at the institution being researched. Seeking out their knowl- 
edge and assistance would be wise (Camp 19S9). 

The second category of public domain information 
includes many of the sources we have alreadv seen, such as 
journals, magazines, and electronic databases. The library at 
the home college or university should not be overlooked as 
an important source for benchmarking data. In addition, lib- 
rary searches can be very fruitful with the use of electronic 
reference searches. Professional associations, consultants, 
and external experts, such as those discussed previously, 
can also yield data for reasonable rates or no cost at all. 
Once the categories of internal and external investigations 
for data have been completed, there is no choice but to 
proceed to the source of the best practice leader identified 
in the first step. 

Original research can be somewhat more expensive than 
other approaches for data collection we have seen, but the 
results can be very rewarding. As in other academic or busi- 
ness research, it is best to approach a prospective bench- 
marking partner with a plan for collecting the data. A 
questionnaire can be useful for listing the data to be bench- 
marked. and it permits more extensiv e data gathering. 
(Questionnaires can be completed in several ways, including 
mail, telephone, and in-person (Camp 19S9). In the 
benchmarking Workbook. byClregorv If. Watson (1992). 
many useful forms are listed, including a benchmarking 
questionnaire proposed for use in a study of original 
research. I he suggested questionnaire lists the following 
questions to be made when contacting another organization: 

/. / It nr do you define l he fimcess? Please describe if. 

2. Do you consider (his f process to be a problem or com cm 
in your company (colleyeh' If not Unlay, teas it a prob- 
lem ui the fiast' 

. >. U hat is the measure of (jua/ity for this fimcess / \\ hat 
are the <. ritena that you use to define excellence in 
process performaiu ef /loir do you measure the outfmt 
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( futility of this f) roc ess' How do you measure progress in 
quality improcement ' 

4. How do you consider cost and schedule in this process? 

5. How much and what type of training do you proride for 
the carious job categories of the process team ' 

6. What process improrements hare gi ten you the best 
ret uni in performance improrements ' 

7. U hat company, excludin'* your awn. do you beliere is 
the best in performing this process ' 

louring their data collection state, Oregon State 
l‘niv ersity's president addressed a co\er letter, along w ith 
the survey form, to the president ot each institution being 
benchmarked. A phone contact was made and instructions 
were also sent directly the person in the other college or 
university who would complete the form t Coate 1993). As 
in most benchmarking projects, initial contacts showed that 
most institutions were willing to do the considerable work 
necessary to complete the form, in order to receive a copy 
of the resulting data. Real benchmarking involv es rec iproci- 
ty. creating a win-win" situation of informal inn exchange, 
that is mutually beneficial (Watson l l W>. 

Analyzing the Benchmark Data 

Once the processes to be benchmarked have been identi- 
fied. the benchmarking partners are chosen, and the data 
collected, the next step ts to determine the current competi- 
tive* gap. There are three types of performance gaps: nega- 
tive. parity, and positive, and are listed in fable 1 1 (Camp 
19<S9). When there is a negative gap. this means that the 
benchmarking panned si have superior operational perform- 
ance 1 numbers in their processes. Kxamples of such num- 
bers might include the unit cost of serv ice being prov ided, 
the level of customer satisfaction, the financial ratio, and 
other such metrics we have seen in higher education bench- 
marking projects. If the gap is negative, a significant effort 
will be required to c hange the internal practices and process 
methods at the home institution to meet or exceed the exter- 
nal findings. The goal is to explain why the differences 
exist and determine the specific contributing factors <>r en- 
ablers. When the comparative analysis finds that the opera 
lions are at parity or have* little difference, further analysis 
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should be done to find the reason. If the operations of both 
organizations are using the most efficient method, then no 
changes are necessary. However, parity is no reason not to 
continue looking elsewhere for best practices. A positive 
performance gap means that the internal practices are supe- 
rior to the oilier institutions being benchmarked. This is not 
to be unexpected, especially in benchmarking studies that 
are broad-based, and part of a consortium or association- 
sponsored project, such as XACT'BO. Experiencing a posi- 
tive gap can help a college or university maintain best 

TABLE 11 

Types of Performance Gaps 
(Camp 1989) 



Type* 


Description 


Consequence 


Negative 


External practices 
superi< <r 


Benchmark 
based on 
external findings 


Parity 


\<> significant 
practice difference 


Further analysis 
justified 


PoMtiv e 


Internal practices 
are superior 


Benchmark 
based on internal 
findings 



practices and justify the continued search tor ways to close 
the other negative gaps which are found. 

In the \ACl BO benchmarking project, participants can 
receiv e a detailed gap analysis, which compares their own 
institution s performance with the means of all study partici- 
pants and cohort groups (’fable 12). The hypothetical analy- 
sis of an admissions office shows that some processes, such 
as departmental cost per inquiry, applicant, and matriculant 
are at parity (for the private research cohort), and have unfa- 
vorable gaps for other cohorts. Descriptiv e comments arc 
also offered which analyze the performance. Although 
benchmarking data is useful, the overall goal of learning 
best practices will need to be completed w ith a site vi.ut to 
the high performing institution(s). 

The traditional v iew of college and university operational 
costs has been functional and organizational, and funding 
tends to be budgeted on the inputs of each department 


















=^&VBLE 12 

— -Gap Analysis for Cost Benchmarks - Hypothetical University’s Admission 

Office (NACUBO 1995) (used with permission). 
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(Ma.SM.-y <S: Myerson lW-i). The assumption in this strategy 
is that the more money that is put into a department, divi- 
sion. or institution, the better the quality that will result. 
Therefore, financial benchmarking is typically seen as input 
driven, and few measures of sen ice output are usually avail- 
able. Most process benchmarking efforts begin to address 
the need for outputs, which can help colleges and universi- 
ties reshape their cost structure. Many of these are more 
"grassroots" efforts that are conducted by individual units 
within institutions. The outputs can be measured using the 
different types of benchmarking we have discussed. Massey 
and Meyerson ( IWi) offered an example of output bench- 
marking. which examines the gift processing performance, is 
noted in Table 13. On av erage, it takes t2 days to acknowl- 
edge a donor's gift to the university at a cost of $19 per 
transaction. If the university processes tH.OOO transactions 
per year, and could meet the Best-in-Class gap of $10. then 
it could improve the responsiveness by 3$ days and reduce 
the- annual aggregate transaction costs by S tSO.OOO, This 
could also yield additional future donations, because the 
"customer " donors would be much better served. 

IT analyzing the benchmark data across the different 
benchmarking tv pcs. such as internal, competitive, industry, 
and generic best-in-class, it is easy to see where the home 
organization truly stands in its performance against others. 
Benchmarking enables the practitioner to go beyond a “gut 

TABLE 13 

Gift Processing - Performance Assessment 
(Massey & Mycrson 1994) 



Ciih 

Acknowledgement 

Process 


Current 

Perfor- 

mance 


Customer 

perception 


Industry 

bench- 

marking 


Best -in- 
class 
bench- 
marking 


Customer 

gap 


Industry 

«ap 


Best-in- 

class 

«ap 


Kespi »nse 


i-i days 


1 i dav s 


mm 


~ days 


mm 


2 ^ dav s- 


3s days 


( ist per 

\i know Judgment 

— 


s|U 


\ A 


Ml 


sp 


s \ 


SK 


MU 



feel" that the process can be improved. It provides the data, 
or pegs" of Where the performance* level can anti should 
advance, both in an industry and extcrnullv. Data can be 



even more compelling if it is compared and analyzed using 
the different benchmarking tvpes. and or if the data is ana- 
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Ivzotl graphically . ('amp ( I9W) and Dale < lW^b otter sug- 
gestions on how benchmarking results can he graphically 
■ analyzed to reveal the performance gaps, Figures “ and K 
show how benchmarking data, that was collected ov er time, 
can Ik* compared with the benchmarking partners, both 
before and alter the improvements were made. It the data 
being benchmarked is a process, then the v ertical Y-axis 
value units will otlen show an increase in better quality, 
speed, or efficiency, as seen in Figure If the data is lor 
the cost ot a process, then the line chart will usually attempt 
to show a decrease in costs relative to the benchmarking 
partners, as seen in Figure s. 



Hie performance gaps between the home institution and 
the competitors are easv to see. lhese examples are intended 

FIGURE 7 — Rate of Improvement Example (adapted from 
Dale 1995, p. 15) 
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FIGURE 8 — Cost Reduction Example (adapted from 
Dale 1995, p. 15) 
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to show how benchmarking data is graphed longitudinally, 
with process changes (after the first benchmarking cycle) 
implemented at alxmt the third or fourth time period on the 
X-axis. This is where the increase in quality speed or efficien- 
cy is e\ idem in both the rate of improvement chan, and the 
decrease in cost reduction is shown in the cost reduction 
chan. When analyzing the data, one must be aware of the 
context in which the data was gathered. If the benchmark 
percentages, ratios, and other metrics were calculated by dif- 
ferent individuals, possibly at different organizations, the re- 
searcher should consider this w hen reading the numbers in 
order to identify false performance results. A XACl'BO book 
published before the current benchmarking era. titled (.'of lege 
and l uireisitv Budgeting, urges caution in the use of cost 
analysis with comparative data for decision-making (Mcisinger 
X Ou beck l 1 ).'-!!). These concerns include the notion that 
different colleges and universities have different sets of deci- 
sion rules that are used to allocate costs to final cost centers, 
or even to develop direct co-ts. 1 example, compensation 
or salarv for deans may be classified as executive manage- 
ment at one institution, and academic administration at anoth- 
er. This kind of dif ference can be accounted for. if the 
benchmarking survey form is accompanied by detailed 
instructions on how to calculate the benchmark ratios and 
data needed for the project. The current N.UTHO bendi- 
marking survey includes descriptive instructions on how to 
calculate the survev responses. However, one other concern 
noted in the 19«St report is the influence of external variables 
on longitudinal data. W hen comparing longitudinal data 
across institutions, changes that are observed by either the’ 
home institution or the benchmarking partners may be influ- 
enced heavily bv external factors, such as shifts in student 
demand, and not from internal academic and management 
dec isions. This is one reason that many benchmarking proj- 
ects rclv on cohot t o! peer groups ol institutions, that may be 
inline-need more or less equally by the environmental or 
external factors, (iregory Watson ( I9 1 M> recommended ask- 
ing a series of questions to clarify the* results, including the* 
f< >lli >vv mg: 

• U hat is the extent of time nrer irhich the process iras meas- 
ured' 

• Was there any change in the measurement system, such as 
the measurement tools used' 



• How much of the measurement system relies on human 
ohserrations or correlation, rersus true data analysis.' 

• l Ion ■ are tl *ese correlations substantiated? 

• Hoie often or at what intervals were the measures taken? 

• What is the estimated margin for error? 

• ,-l/v the measures verifiable . auditable, and repeatable? 

<p. 



After the data has been analyzed, the process enablers 
which equip the high performing institution being bench- 
marked to achieve its status, need to be identified. An 
enabler can be a system, method, document, training, or 
other technique that facilitates the successful implementation 
of the benchmarked process. 

Implementing Changes 

finally, afier the data has been collected and analyzed, and 
the process enablers identified, the benchmarking el forts 
must be converted into actions for improving the processes 
which were studied. It is well known that administrators 
receive many reports, and often, just allow them to collect 
dust on a shelf. Although very interesting to college and 
university personnel, benchmarking results should be more 
than an academic exercise. Short-term and long-term goals 
should be established by the administrator or faculty member 
in charge of the projec t to eliminate the negative perform- 
ance gaps uncovered. The short-term goals should include 
reducing the' negative gap. and at least reaching pantv. b\ 
adapting the best-practices discovered at other organizations, 
l.ong-term goals should seek to maximize the positive perform- 
ance gap and become the standard by which other organiza- 
tions will benchmark, fan of the long-term plan should be 
to integrate benchmarking into all ol the* vital processes w ith- 
in the college- or university, with continual evaluation at reg- 
ular intervals. Benchmarking should not be a one-time* 
project or snapshot of a process performance, it should be 
ongoing (no less than quarterly) and use longitudinal data 
that can be- charted and graphed. II benchmarking is fully 
integrated and implemented, then the- organization will 
alwavs remain current with changing market conditions 
(damp IWJ). 

■spe-ndolmi < l‘) l )J» staled there- are- a numbe r of actions 
that should Ik- taxon during this final stage* ol the* hist 




If benchmark- 
ing is fully 
integrated and 
implemented, 
then the orga- 
nization will 
always remain 
current with 
changing 
market 
conditions . 
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benchmarking iteration. The following actions are oitered 
in random order: 




• Produce a benchmarking report summary. 

• Present benchmarking findings to benchmarking 
customers (student, faculty, administrative units, etc.) 

• Communicate findings 

— Internal — other functional groups 
— Benchmark partners 

• Look for opportunities 

— Product process improvements 

— Learning — bring new ideas and concepts into the organ- 
ization 

— P< inning functional networks 

• Lncourage recycling efforts 

— Modify improve the use of the process 
— introduce new related subjects for benchmarking 



The benchmarking report is intended to be delivered to 
the benchmarking customers, which for colleges and univer- 
sities could be students, faculty, administrative units, compa- 
nies that hire the graduates, state governments, and other 
external agencies. A summary of the data that w ere collect- 
ed and analyzed should be included, with a record of the 
organizations that were benchmarked. In the corporate 
world, lengthy reports are becoming less common 
{Spendolini 1992). but benchmarking reports generated by 
organizations such as XACI BO can be of significant length 
(Kempncr 1993). The report may contain the statement ol 
need or purpose for the project, a list ol the project cus- 
tomers. the projec t team, calendars ol ev ents, the subjects 
w hich were benchmarked, the information sources, method- 
ology. results, analysis, and future actions to be taken 
(Spendolini 1992). In the held ol higher education, which 
has familiarity with research methodology, it could be espe- 
c iallv important to include a somewhat detailed report, in 
order for the project to gain the lull respect of the college or 
university cnmnumiiv it hopes to change*. When the find- 
ings are presented to the benc hmarking customers, both a 
written and oral version of the* benchmarking report are 
suggested lor maximum effectiveness Of course, in addi- 
tion to the data results and analysis, the recommendations 
for process improvements by the benchmarking team com- 
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mittee must lx* communicated at this time, along witli spe- 
cific goals, timetables. and funding requirements to enact 
meaningful changes. The majority of the process improxe- 
ments recommended will involve one or more ot the follow- 
ing improvement outcomes: 

• Product process iniproivmcnts — the primary goal, w here 
the henchmarker.s use the information collected to alter 
the actual processes that were analyzed. 

• Lcamiui > — for many of the benchmarking projects 
reviewed for this report, one of the most common reports 
was that the benchmarking process was very valuable tor 
institutional self-analysis and for seeing the college uni- 
versity from an external point of view. Also, the opportu- 
nity to learn new ideas and return them to the home 
organization U vers rewarding. 

• Pormintt functional net icorks—OWcn. an unexpected 
outcome and by-product occurs w hen the benchmarking 
participants establish valuable contacts at other institu- 
tions. whom they can call for information about bench- 
marking or non-benchmarking related improvement 
activities. 

As stated earlier, for the benchmarking process to be fully 
effective, it needs to be recycled or recalibrated, and the 
data has to be measured ox er lime. Often, benchmarking 
practitioners become more proficici t in their use o! the 
process, and w ill diagnose their oxvt. individual process 
strengths and xxeaknesses. and adjust their benchmarking 
behaxiors accordingly (.spendolini l l »2) In addition, nexx 
subjects for benchmarking are often added or deleted in 
subsequent years of the project, as is the case xx ith NACl BO 
(NACl'BO IWs), 

Aside from the overall benchmarking report. Gregory 
Watson ( IWJ) suggested the creation ol an action plan lor 
implementing each indixidual process enabler. This action 
plan can lolloxx the general formal of a Japanese hoshin 
plan, xxhich he defines as "a system for establishing process 
objectives and goals and implementing them through a set 
of strategies, that are monitored at particul.tr milestones to 
determine if the process is on target" (p. Breakthrough 
improxements can be readily identified if a significant gap in 
performance is seen in the critical success factors of the kex 
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processes being studied. For each process, a process 'own- 
er'' should be identified. who will have responsibility for the 
process functions and work activities, file owner can be an 
individual or group within the institution, who will oversee 
the efficiency, effectiveness, and economy ot the process by 
eliminating waste and implementing the improvements. To 
help the process owner build the action plan, the form is 
outlined in Figure 9. which identifies the key process and 
critical success factor for each improvement being imple- 
mented. The form begins by listing the key process being 
measured and the critical success factor lor the process. 

Next, the date that the action plan is written and the summa- 
ry of the benchmarking study results are entered. I nder 
objective, there should be the recorded actual changes that 
this action plan will accomplish, the expected date ot com- 
pletion, and the performance level ol the critical success 
factor which is sought. The short-term goals are typically six 
months to one year in length, and long-term goals should 
have an expected date of achievement. The benchmark, or 
peg. against which this process is measured, is recorded 
with the date of the observation, the institution's name, level, 
and rate of performance. The last section of the form lists 
specific strategies required for achiev ing the changes, along 
with the name of the owner responsible for completion. 

Kach of the strategies should have targets and milestones tor 
the performance. A previous section showed that graphical- 
ly monitoring process performance can be a very useful part 
of reinforcing the benchmarking goals. The data from the 
action plan can be used in conjunction with the performance 
charts to set realistic and achievable performance goals. 

As with anv organizational improvement technique, there 
is the possibility that action taken on the benchmarking 
project will not be successful. One proven way to avoid this 
is to studv the causes ol failure found by others and take 
steps not to repeat them. 

The American Productivity and Quality Center conducted 
a research study on the causes of benchmarking project 
failures. Survey respondents were asked to rate factors 
identified for failure on a five-point scale (5 - high cause) 
to indicate the significance ol the factors contribution to an 
unsuccessful benchmarking study. Multiple answers to the 
survey question were not allowed. The results are listed as 
f< >lh >vv s: 
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Taruets and Milestones 



The lop lour c auses of benchmarking projec t failure w ere 
poor planning, no-top management support, no process- 
owner involved. and insufiieient benchmarking skills. All 
four of these problems can lie' addressed by colleges and 
universities that plan to conduct a project, and have been 
discussed earlier in the review of the benchmarking litera- 



hnnninny • in Higher F.duattinn 




TABLE 14 

Causes of Benchmarking Study Failures 
(APQC 1993, p. 131) 



Question 



Poor planning 



Rating (1-5) 



No top management support 


3 “U 


No process owner involved 


3. SO 


Insufficient benchmarking skills 


3. St 


Low priority 


3.1 i 


Results not believed 


23)3 


Lack of interest 


2 *<> 


Lack of funding 


2.<>S 


Poor teamwork 


2.<r 


Personnel turnover 


2.20 


No better pi act ices found 


2.1" 


I nterperst >nal cc inflict s 


2.0" 



lure and its application to higher education, Proper project 
planning, support from the president s office and the “grass- 
roots” units where the efforts should take place, and proper 
employee training are important for all organizational 
improvements. 

Benchmarking Softw are 

Due to its reliance on stepw ise methodology, computer 
software has been developed lor conducting a benchmark- 
ing project. Recently, data was submitted electronically for 
the 1WS fiscal year NACT'bt ) project, in order to increase 
speed ol data collection and to facilitate data integrity 
(XACriK) ID 9 S). The benchmarking software is provided 
to the participants on a Microsoft I'xcel’ spreadsheet, and 
all participants receive a complementary educational version 
of the software. There is also av ailable, at least one general 
computer software package, which is specifically designed 
to help simplify a benchmarking project at any organization. 
I.earneiTirst s Hcndmutrking software was developed in a 
joint venture w ith the American Society for ( v )ualil\ Control 
i.\M v K! 1993 1 . This software application breaks the bench- 






marking process into simple, step-by-step activities to con- 
duct successful benchmarking projects for both beginners 
and experienced benchmarkers. It is an interactive 
Windows' M application that provides the user with specific 
examples, dialogue questions, suggestions, guidelines, and 
checklists that help earn* out consistent and effective bench- 
marking projects (ASTM 1995). The software was adapted 
from the methodology of benchmarking expert H. James 
Harrington, president of the International Academy for 
Quality and the international quality advisor for Krnst Ox 
Young. The interface and illustrations allow for quick and 
highly -interactive navigation through an entire benchmark- 
ing process, in l c > detailed steps or activities: 

1. Identify ivlutt to benchmark 

2. Obtain management support 
J. Here! of) measurements 

-i. Develop the data collection plan 

5. Review plans with location experts 

6. Characterize yot/r benchmark team 

7. Collect internal published information 
S. Select internal benchmarking i» sites 

9. Collect internal original research 
K). (Conduct interview and surveys 

1 1. Form benchmarking committee 

12. Conduct internal site visits 

1 J. Collect external published information 
l~i. Conduct external original research 
1 5 Identify corrective actions 
lb. Develop an implementation plan 
l ~ Cain approval of implementation plan 
US. Implement changes and measure impact 
/9 Maintain a database { ASTM 1995, p. 

This approach follows and expands upon the multi-step 
benchmarking processes that were rev iewed in the second 
chapter, and could prov ide a useful framework tool for col- 
lege and university personnel who plan to conduct a bench- 
marking project. The package currently sells for S C 5. and 
is distributed by ASTM. lot) Harr Harbor Drive. West 
C.onshohocken. I'A 19 iitt-2959. Professor Charles Harclay 
< 1995) .it the I'niversity ol Hawaii reported that the software 
has also been Successfully used it) a graduate business pro- 
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gram curriculum, and that class benchmarking projects are 
required of students in the Production and Operations 
Management and the Business Strategy courses. 

Conclusion 

More than 20 years ago. Martin Trow ( \ ( P5) wrote about the 
tremendous growth in higher education, and the variety of 
problems it creates for higher education in areas such as 
curriculum, finance, government and administration. He 
believes that many of the current problems are actually a ' 
related cluster of difficulties arising out of what he calls the 
transition from elite, to mass, to universal higher education. 
The different phases are associated with different functions 
of higher education, for students and society at large. I'nder 
the current phase of “universal higher education.” when 
more than 50 percent of the students of eligible age attend 
college at some point. Trow stated that management proce- 
dures become more dependent on quantified data for the 
assessment of costs and benefits. One method of quantify- 
ing the cost and other data now available and being used by 
higher education is benchmarking. However, benchmarking 
does more than quantify the costs and benefits. It enables 
the organization to learn, and continue to learn, best prac- 
tices for improving its operations, whether the 
improvements are in the teaching of undergraduate or grad- 
uate programs, research, or college and university adminis- 
tration. 

This report has rev iewed the origins of the benchmarking 
process, examined its use in higher education today, and 
provided instruction on how to begin a project to compare 
and improve an institution of higher education. It is impor- 
tant to understand the different types of benchmarking dis- 
cussed in the second chapter and to know that some 
approaches to benchmarking arc more appropriate than 
others. For example, some benchmarking practitioners 
believe that it is always necessary to compare their institu- 
tion only with world-c lass organizations, or else the 
improvement goals will be too easy (Thor 1995). They 
believe that benchmarking is to be used only for obtaining 
at least a tenfold increase in productiv ity, and that a mere 
doubling of performance is not sufficient. There are several 
problems with this fear of “cohort mediocrity." as one 
benchmarking consultant labeled it (Dale 1995 ). First, no 
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organization is world-class in all areas, only institutional 
practices, processes, and approaches are world-class. It is 
possible to find a lx*nchmarking partner that may not be 
well-known for overall quality, but may lx* very good at the 
process that is being sought for improvement. In addition, it 
a true world-class best practitioner can be found, it may be 
difficult or impossible to arrange a benchmarking site visit 
because of the competition to gel the same information. 

Less waiting time is often available at other institutions, 
which, although not as well known, can offer useful 
improvement strategies. Quick response to the rapidly 
changing competitive env ironment can be critical lor suc- 
cess. especially in the "nanosecond nineties" (Peters 1992). 

Kinni ( 199-0 stated that there are a few lessons that con- 
sistently occur in the literature on benchmarking: 

• benchmarking is not a profit center, t nderstaud its uses 
and pull it from the toolbox only when it is the best tool for 
the job. 

• Sturt hr benchmarking functions or processes that are 
critical to success. Don 7 iraste time or money on insignif- 
icant studies. 

• benchmarking requires self-assessment. You cannot 
uncocer performance gaps without first understanding 
and measuring your own processes. 

• (lather the most cost- effect i t eness information first. The 
more you learn before an on-site risit. the more you will 
lake away from it. 

• Implement . implement . implement! Without implementa- 
tion , a benchmarking study is an academic exercise of no 
ralitei p. 28). 

Other recurring themes in the benchmarking literature 
include the idea that benchmarking is iundamcntally a learn- 
ing behavior by the institution, and that proper planning is 
required tor a successlu! benchmarking effort. Colleges and 
universities must realize that they, like all organizations, do 
not perform all, or even most, of the functional processes 
best. Lor each process performed, there are leaders who 
are the best in a cohort group, best in industry, and best-in- 
class. Benchmarking is the identification of metrics, or com- 
mon measures and measurement techniques, to determine 
who is the best, and the application ol these techniques to 
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organizational processes (Losh 199-0. It is critical that 
benchmarking partners use the same metrics, because no 
comparativ e analysis can be made on unlike data. For 
.benchmarking to be truly effectiv e, it is important to use the 
metrics to make changes and then reassess the improve- 
ments a her the changes are made, in order to measure the 
performance improvement. Simply obtaining the measures 
without action is a waste of time and money for the college 
or univ ersity. 

The literature reviewed on benchmarking in higher edu- 
cation tends to be very process oriented, and usually not 
strategic in its use by colleges and universities. While it is 
good advice for institutions that are beginning to use bench- 
marking to start out with small projects and then proceed to 
benchmark broader areas of cov erage, a broader use of this 
tool beyond the functional process level and into strategic 
planning and goal-setting can be very helpful, as colleges 
and universities seek to position themselves competitively in 
the new information societv. Today, institutions of higher 
education are discovering that they can no longer attempt to 
follow Hzra Cornell’s v ision to ‘found an institution where 
any person can find instruction in any study" (Yeysey I9(r>). 
Increasing competition, the information explosion, and 
changing student needs have made it unwise for institutions 
to lack focus and specialization. In his book titled Strategic 
Bench nut rhitii*. Watson 1 199s) stated that strategic bench- 
marking involves the application ot process benchmarking 
techniques to the development of a greater understanding of 
strategic issues, by forming cooperative alliances with other 
organizations. Based on Watson's suggestions for all types 
ol organizations, and other literature on the concerns in 
higher education, issues that could be addressed by strategic 
benchmarking in higher education include: 

• Building core competencies that will help sustain compet- 
itive advantage 

• Targeting a specific shift in strategy, such as entering new 
educational markets or new educational programs 

• Developing a new service or making a strategic acquisi- 
tion 

• Creating an institution that is more capable of learning 
how io respond in [anl uncertain future because it has 
increased its acceptance to c hange. 



Strategic benchmarking tor colleges and universities 
should be closely linked to the strategic planning process. 

The benchmarking studies which are conducted could 
address specific issues in the plan, such as the establishment 
of goals and objectives, development oi the institutional 
infrastructure, selection of key functional processes tor 
improvement, identification of technology areas for develop- 
ment. etc. (Watson 1993b 'l'be college or university presi- 
dent and senior staff should set the breadth of the strategic 
benchmarking study, and the methodology can be similar to 
the process benchmarking discussed. 

Benchmarking is not a remedy for all of the problems 
that face higher education in the 1990s: it is only one of 
many practical approaches to improving organizational qual- 
ity and reassessing how resources are spent (Rush 199 D. 
Other tools such as committee studies, "task force white 
papers, and further studies only delay the organization from 
the final goal of making well-planned changes. Another 
concern is that benchmarking requires an underlay of expe- 
rience in quality management, winch many colleges and 
uni\ersities do not yet have. Benchmarking requires the 
understanding of terms such as teams, processes, customers, 
metrics, outputs, and others that may seem daunting and 
unfamiliar to untrained personnel. Marchese ( 199 s) staled 
that like TQM itself, the practice of benchmarking has a 
threshold barrier, because it does require extra effort to 
tx*gin and sustain a project. Business corporations, health 
care organizations, and others have tended to be pressured 
for improvement efforts more profoundly than institutions of 
higher education, where the sense of felt need and urgency 
for improvement is relatively low . Despite these concerns, 
benchmarking offers the potential to teach institutions of 
higher education how external perspectives, on organiza- 
tional processes, can enrich internal values. When com- 
bined with TQM. BPR. and continuous quality improvement, 
benchmarking is a potent vehicle for promoting substantive 
change-oriented action because of its reliance on hard data 
from external comparisons. Benchmarking blends with the 
entire qualitv improvement process (Dale 199^). IQM is the 
underpinning, holistic approach that includes benchmarking. 
Business process reengineering is the natural result of 
benchmarking, as a successful benchmarking project deter- 
mines that the pun ess being examined needs to be 
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changed. Wheaton College learned how to integrate tench- 
marking with TQM and BPR efforts, and help bring about 
significant improvements, build staff skills, and begin a revo- 
lution in the way staff approach their work (Kempner 1993). 
W heaton sought to use TQM for customer focus and staff 
involvement. BPR for rapid results, and benchmarking to 
ensure that both TQM and BPR address areas of greatest 
potential and to avoid repeating past mistakes. Edwin J. 
Merck, Wheaton's vice president for finance and operations, 
added: 

Benchmarking really gives more power to our TQM and 
BPR efforts. Continuous improvement could he pur- 
sued within our own environment exclusively, hut 
benchmarking has helped us dovetail with other 
improvement processes at other places. It introduces 
ideas ive might l have} never thought of and it keeps ns 
more competitive (Kempner 1993. p. .30). 

Although Wheaton participates in a professional associa- 
tion study (NACl'BO), benchmarking can also help an orga- 
nization continue to learn how to improve, if it is done 
individually, or through a consortium or professional associ- 
ation. 

Twenty years ago, it would be unheard of for Carnegie 
Mellon University to improve the campus renovations 
process by partnering with the Eastman Kodak Company 
(Nicklin 199S), Benchmarking allows institutions to break 
out ol the old way ot doing things, such as using an intu- 
ition-based. or "gut-feeling," approach to business process 
analysis. Looking at a process. and deciding without know- 
ing why it is done that way. or rationalizing it by saying, “it s 
always been done like that." is an excuse that is too com- 
mon for not making improvements. Ken Bardach. MBA 
Program Director at Michigan State University, stated that 
"Benchmarking lot *es us to do the things that good man- 
agers want to do. but find excuses not to do . . . It forces us 
to put mirrors around us. look at what we're doing, and see 
if we re doing it well" < AACSB 199 t. p. \~t). The "new 
paradigm" that is fast approaching, and already here for 
many institutions, requires that we build efficiency into the 
bade structure and functioning of the organization (Keeton 
<S; Mayo-Wells 199 1 ). Part of this new pattern is that todav. 
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higher education must continually improve, just as individu- 
als in soviet v must pursue lifelong learning. It learning is to 
be the main locus, and students are now using technology 
continually to receive training at home or at the worksite, 
then it is vital that colleges and universities keep up with the 
competition by continually comparing and improving with 
new tools such as benchmarking. 
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Point Values 

l .0 Leadership 2Q 

1.1 Senior Administration Leadership -* l) 

1.2 Leadership System and Organization 30 

1.3 Public Responsibility and Citizenship 20 

2.0 Information and Analysis 73 

2.1 Management of Information and Data 2-> 

2.2 Comparisons and benchmarking 13 

2.3 Analysis and l se of Institution-Level Data 33 

3.0 Strategic and Operational Planning 73 

3.1 Strategy Development 

3.2 Strategy Deployment 30 

4.0 Human Resource Development and 150 



Management 

- 4.1 Human Resource Planning and Evaluation 30 

4.2 Faculty and Staff Work Systems 30 

•4.3 Faculty and Staff Development 30 

i. t Faculty and Staff Well-Being and Satisfaction ■*<) 

3.0 Educational and Business Proc ess Management 150 

3.1 Education Design *0 

3.2 Education Delivery 

3.3 Education Support Service Design and Delivery 2s 

3 . 4 Research. Scholarship, and Service 20 

3.3 Enrollment Management 20 

3.(i Business Operations Management 20 

6.0 Institutional Performance Results 150 

0.1 Student Performance Results 100 

0.2 Education Climate Improvement Results so 

0.3 Research. Scholarship, and Sen ice Results 40 

O. i Business Performance Results <0 

7.0 Student Focus and Student and Stakeholder 

Satisfaction ^3^ 

“1 Current Student Needs and Expectations tO 

” 2 Future Student Needs and Expectations 30 

~3 Stakeholder Relationship Management to 

| Student <N Stakeholder Satisfaction Determination 30 
“.3 Student and Stakeholder Satisfaction Results 30 

”.(i Student and Stakeholder SatNaclion Comparison to 

. TOTAL POINTS M 
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Selected Baldrige Award criteria descriptions requiring 
benchmarking: 

2.2 Comparisons and Benchmarking (15pts.) 

Describe the institution s processes for selecting and using 
comparative information and data to support overall college 
or university performance improvement. 

Areas to Address 

a. How comparisons and benchmarking information and 
data are selected and used to help drive improvement of 
overall institutional performance. Describe: ( 1) how needs 
and priorities are determined: (2) criteria for seeking appro- 
priate information and data — from within and outside the 
academic community; ( D how the benchmarking informa- 
tion and data are used within the institution to improve 
understanding of processes and process performance; and 

< t> how the information and data are used to set improve- 
ment targets and or encourage breakthrough approaches. 

b. How the institution evaluates and improves its overall 
process for selecting and using comparisons and 
benchmarking information and data to improve planning 
and overall college dr univ ersity performance. 

6.0 Institution Performance Results (230 pts.) 

The Institution Performance Results Category examines stu- 
dent performance and improvement, improvement in the 
institution's education climate and institutional services, and 
improv ement in performance of business operations. Also 
examined are performance levels relative to comparable 
institutions and or appropriately selected organizations. 

6.1 Student Performance Results (100 pts.) 

summarize results of improv ement in student performance 
using key measures and nr indicators of such performance. 

Areas to Address 

a. current levels and trends in key measures and or indica- 
tors of student performance. 

b. for results presented in (via. demonstrate that there has 
been improvement in student performance. 

v for the results in (via. show how student pcrformaiue 
and performance trends compare with comparable institu- 
tions and or comparable student populations. 
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APPENDIX B— THE BENCHMARKING CODE OF 
CONDUCT 



i|r<iin the benchmarking Management Cmide. published by 
the \menijn Pmcliu tiv itv and Quality Center. ( APQC 1993. 

p. 

Preamble 

Nciu hmarking — ilk* process <>! identifying and learning 
from best practice's anyw here in the world — is a power! ul 
u>ol in the tjuesi lor eominuous improvement. 

To guide beiu hmarking encounters and to advance the 
professionalism and effectiveness ol benchmarking, the 
International bene hmarking Clearinghouse, a serv ice ol the 
American Produc tiv itv and (Quality Center, and the Strategic 
Planning Institute Counc il on benchmarking have adopted 
tht'' common Code ot Conduct. We encourage all organiza- 
tion'* to abide* In tin*' Code ol Conduct. Adherence to these 
principle** will contribute* to ellicient. ellective. and ethical 
benchmarking. This edition ol the Code ol Conduct has 
been expanded to pro\ idc* greater guidance on the* protocol 
ol beiu hmarking lor beginner**. 

The Benchmarking Code of Conduct 

individuals agree lor themselves and their company to 
abide* bv the* billowing principles for benchmarking with 
t )tlie*i < irg.mi/ati< ms. 

I . Principle of fx\i><ilitv 

• II there is anv potential question on the* legality of an 
ac liv its . ck m l elo it. 

• Av oid dise ussions or actions that could lead to or imply 
an mtoivsi in restraint ol trade, market, and or c ustomer 
allot ation schemes, price* fixing. dealing arrangements, 
bid rigging, or bribery. Dont discuss costs with competi- 
tois il tosts are* an element of pric ing. 

• Retrain hom the* acquisition ol trade secrets from anv 
means that could be interpreted as improper, including 
the breach or indue c*mcnl ol a breach of duty to maintain 
see ice v I )o not disc lose* or use* any trade se*cret that may 
have been obtained through improper means, or that was 
dist losed bv another in v iolation ol a duly to maintain its 
see ivc \ i >r limit its use*. 

• I )» > nt *t. as a e < insult. mt < >r a clie*nl. extend one bench 
marking snub 's findings to another company without first 
obtaining permission horn the* panic’s ol the* stin.lv. 
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2. Principle of li\vban.t>e 

• Be willing to provide the same tvpe and level of informa- 
tion that you request from your Benchmarking partner to 
your Benchmarking partner. 

• Communicate fully and early in the relationship to clarify 
expectations, avoid misunderstandings, and establish 
mutual interest in the Benchmarking exchange. 

• Be honest and complete. 

3. Principle of Confidentiality 

• Treat Benchmarking interchange as confidential to the 
individuals and companies invoked. Information must 
not Be communicated outside the partnering organiza- 
tions without the prior consent of the Benchmarking part- 
ner who shared the information. 

• An organization s participation in a study is confidential 
and should not Be communicated externally without its 
prior participation. 

i. Principle of l sc 

• [ se information obtained through Benchmarking only for 
purposes of formulating improvement of operations or 
processes w ithin the companies participating in the 
Benchmarking study. 

The use or communication of a Benchmarking partner’s 
name with the data obtained, or practices observed 
requires the prior permission of that partner. 

Do not use Benchmarking as a means to market or sell. 

S. Principle of First -Party Contact 

• Initiate Benchmarking contacts, whenever possible, 
through a Benchmarking contact designated By the part- 
ner organization. 

• Respect the organizational culture of partner organiza- 
tions and work within mutually agreed upon procedures. 

• Obtain mutual agreement with the designated 
Benchmarking contact on any hand-off of communica- 
tion. or responsibility to the other parties. 

o. Principle of Third Parly (j intact 

• Obtain an individual's permission Before providing his oi- 
lier name in response to a contact request. 



• Avoid communicating a contact's name in an open forum 
without the contact s permission. 

Principle of Preparation 

• Demonstrate commitment to the efficiency and effective- 
ness of benchmarking by completing preparatory work 
prior to making an initial benchmarking contact, and 
follow ing a benchmarking process. 

• Make the most of your benchmarking partners time by 
being fully prepared for each exchange. 

• Help you benchmarking partners prepaic by providing 
them with an interview guide or questionnaire and agen- 
da. prior to benchmarking visits. 

«s. Principle of Completion 

• Follow through with each commitment made to your 
benchmarking partners in a timely manner. 

• Complete each benchmarking study to the satisfaction of 
all benchmarking partners as mutually agreed. 

9. Principle of l nderstandin g and Action 

• I 'nderstanding how your benchmarking partners would 
like to be treated. 

• Treat your benchmarking partners in the way that each 
benchmarking partner would like to be treated. 
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APPENDIX C — BENCHMARKING RESOURCES 



W hen conducting :i benchmarking project, il is important to 
.search thoroughly for information on other institutions that 
are reported as high performing in the process! esi which 
are being analyzed. In addition to the traditional KRIC ser- 
vice, and the books and articles cited in this report, there are 
other useful sources of primary and secondary information 
for institutions of higher education, such as: 

• Academe Todav — A complimentary service reserved tor 
subscribers to the Chronicle of Higher hducation provides 
statistics, reports, and the past five years of articles from 
the Chronicle, which are searchable and available 1 for full- 
text reading or downloading. 1'he World-Wide Web 
address is: http: chronicle.com 

• AKRA l.istservs — The American Hducational Research 
Association sponsors It l.istservs on the Internet. I here 
arc* two general Lists. 1 1 Division lists and a list for giadu- 
ate students. A HR A- 1 Division J is for postsecondary edu- 
cation. All Lists reside at the Internet address 
L1STSKRY tTAM'ACAD.BH'NKT which is at Arizona State 
Iniversity. 

• Ask KRIC Virtual Library— This is one. of the best educa- 
tion sites available via the Internet, and allows access to 
the Department of Kducation's KRIC Database. 1 he 
Internet address is: http: ericir.syr.edu 

• BRRRKKMi-L — This Listserv was created in mid-April 

and tries to facilitate the development of a human 
network consisting of members with shared interests and 
skills in the field. Its purpose is to promote a construc- 
tive dialogue about college and university related 
Business Process Reengineering-related information. Hie 
Internet address is: LISTSKRVKRotLIS I S.ACS.OI IIO- 
STATK.KDC 

• CQl-L Listserv — This Listserv provides a moderated forum 
for all individuals interested in the principles and prac- 
tices of Continuous Quality Improvement and its applica- 
tion to the improvement of higher education. It is 
sponsored b\ the American Association for Higher 
Hducation. and it is available at the following Internet 
address: Cgi-LfCMK.NKT 

• Hducational Benchmarking Inc. <HBM — This is a priv ate 
consulting company formed by Joe Pica, assistant dean 
and MBA program director at Indiana I niversity. and 
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Glenn Detrick. an educational consultant. Thee work 
with the Graduate Management Admission Council and 
the American Assembly of Collegiate Schools of Business 
on various benchmarking projects for undergraduate and 
graduate business education. 

• HHPROC Assessment Home Page — -These archives 
address many areas ol assessment in higher education, 
including summative. formative, student self-assessment, 
institutional self-assessment, mandates, classroom assess- 
ment techniques, and other uselul serv ices including the 
lilvPROC-I. and the CQI-I. Archive. The Internet address 
is: http: pobox.com -higher.edueation 

• International Benchmarking Clearinghouse (IBC). a divi- 
sion of the American Productivity and Quality Center 
(APQO- — provides a variety of products and services for 
benchmarking, including consultants, training and adviso- 
ry sen ices, publications, a database, case studies, and 
best practices classified by key work processes. 
Membership information is available free. American 
Productiv ity and Quality Center. 123 North Post Oak 
Lane. 3rd Floor. Houslan. T\ 02 t- 9T telephone <SUU- 

or via the Internet World-W ide Web at: 
http: wvvvv. apqc.org 

• NAC't BO’s Benchmarking Process for Improvement in 
Higher Kducation. Conducted annually with the assist- 
ance of Cooper's#; Lybrand. L.L.P.. Barbara S. Shafer#; 
Associates. John Minter Associates, and Sterling 
Research Sutton Associates. For further information or a 
prospectus, contact the National Association of College 
and I'niversiiy Business Officers. One Dupont Circle. 

Suite 3()u, Washington. DC 2<K)3(>-1 ITS. 

• National Cooperative Data Share - Benchmark Data 
l.xchangc. by John Minter Associates. Inc., is a subscrip- 
tion serv ice offering immediate access to higher education 
benchmarks produced by participating institutions. 
Institutions may participate in categories of their choos- 
ing. such as revenue, expenditures, balance sheet, gains 
and losses, faculty, undergraduate and graduate enroll- 
ment. graduation, retention, staff, and student services 
cost comers. This service is currently available on the 
World W ide Web at 

http: www.edmin.com jma.ncds.html 

• Soc iety lor College and I niv ersity Planning (SCI P) links 
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to higher education resources — A very useful page con- 
taining World-W ide Wei 1 ) starting places for on-line 
research, news periodicals, higher education periodicals, 
speeches statements, departments of higher education, 
planning, physical plants, etc., and other higher education 
associations. Internet address: http: www- 
personal.umich.edu -scup I.INKS.html 

• The Benchmarking Kxchange (TBT) — This information 
system is designed specifically for use by individuals and 
organizations involved in benchmarking and process 
improvement. TBK provides users with a comprehensive, 
centralized, and specialized forum for all phases of 
benchmarking. Several colleges and universities are cur- 
rently listed as members. The Internet World Wide 
Address is: http: wvwv .benchnet.com 

• l .S. Department of Education Web Server, a comprehen- 
sive resource for educators which contains goals, inititia- 
tives. new s, press releases, funding opportunities, and 
official documents of the agency, including hypertext 
publications. I'scful resources include the education 
Department's Teacher's and Researcher s Guides. The 
Internet address is: hup: vvvvw.ed.gov 
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benchmarking functioning and human resource's training. 

13 1 i 

lurklional benchmarking. 39-31. .Sec' dl><> operational benchmarking 
lundional Benchmarks in Higher Kducation. 3t 
fund lot Improvement of Post secondare Iduealion. is 
functional networks foimation. S3 

Ci 

( i.ulhcr ( I99S » 

information lechnulogv helping in monitoring performance. 

gap analvsjs ol oist bem hm.itks example, 
tit 1* Seetieneral College Program 
ticncral College Program lUriuulum. s9 
generic bene hm.ii king. 3 I *3 

most c Iff I li uli to use but best lot long Ic-im use*. ->2 
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example useless unless studied with the aid ot theorv. a 
GMAC. See Graduate Management Admission Council 
GMAC PBI 

Benchmarking Project. t3-n 
Benchmark Processes sample, a t 
government agencies use ot the term benchmarking, lb 
Ciraduate Management Admission Council. t3 

graphical analysis ot benchmarking reveals fvrlormance gaps. X- 

Si 

greater student -centeredness as a result of quulitv efforts. 



H 

Hammer and Clumpy ( IW> 

benchmarking helps a reengineering team with new ideas. 
3<> 

1 iatnmer and Clumpy ( lbbG 

Business Process Reengineering is a tool for catching up. 
not for jumping way ahead. 3^-3h 
1 larrington. 1 1. James 

benchmarking software developed from methodology of. S" 
Harvanl Business school 

used benchmarking to improve deliver) ol prominent 
graduate business programs. V'-S.x 
f fan ard l mv ersitv 

as an adaptation of the P.nglish' undergraduate I’olleges. si 
health and disability benefits in the energy and communuations 
industries benchmarking. 12-13 
1 1 l-IPROC Assessment Home Page, m2 
Heverly and Cornesky ( lbb2> value of TuM. ^ 
l ligher P.diu alien 

Consulting group ol the firm Coopers & l.y brand. io 
Data sharing Consortium. is 
potential data and information soun.es. ~3 
higher education in the Who's 

tools tor improv ing organizational quality and reassessing 
how resoun.es are spent. Of 

"High Performing Colleges: The Makolm Baklrige Ntition.il Quality 
Aw. ml as a framework for Improving Higher Pdikution . 
h> 

horizontal benchmarking him Honing. 3^ 

hoshin plan, see Japanese hnshiu plan 

human learning process analogous to Ihmh hmarking. lb 20 
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benchmarking at. 12 
S-step benchmarking process, 2S 
Hies ( 1WI 

highest interest at Brigham Young I'niversity in academic 
not administrative, benchmarking. 68 
Illinois Board of Higher l-ducation 

use of benchmarking for purposes outside its definition. 
UMd 

Independent Colleges and I'niversities of Indiana. Inc.. i8 
Individual Benchmarking Project. SO-SO 
industry benchmarking. See functional Benchmarking 
information technology use in monitoring performance and quality. 

Inger < loo-c 

educators normally only borrow practices from other 
sc hools. | i 

innovation achievement. S” 

institutional benchmarking partners identification. 

Institution Performance Results ol Baldrige Award definition. 0(> 
institutions of higher learning need locus and spec iali/ation, 00 
Internal Benchmarking. 28-20 
International 

Academy for Quality. 8“ 

Benc hmarking Clearinghouse. 0“. H>2 
Quality study. M 

Iona College's campus m Yonkers. \ 

Iowa State 1 I'niversity on list of I diversities to benchmark. Si 
Ithaca College 

joined The Benchmarking IXchange to obtain partners. 
“I"2 

J 

Japanese hoshin plan definition. 8.^ 

John Hopkins I mvei'sitv modeled on (ierman umversitv. \i 

K 

Kansas state I 'diversity on list of l diversities to benchmark. Si 
Kellei t 1 08 s » 

c nlic ism o|. 8 

predicted a< .ulemu competition h»r resources, i S 
hei ridge ( IOOSi 




concept of benchmarking is foreign to true Doming 
philosophy. Mi 

key mkvi'w indices used at I'niversity of Miami. 69-“0 
kinni < IWD 

lessons that consistently occur in benchmarking literature. 
89 



L 

LearnerPirst's lit j ncbninrkni,i> softw are. 8(>-8“ 
learning outcomes definition. 83 
Learning Resources Network. »9 
Leibtried and McNair ( 1992) 

benchmarking is analogous to human learning process. 
19-20 

LKRN. See Learning Resources Network 

lessons that consistently occur in benchmarking literature. 89 

Lily Lndowment. »8 

L. L. Bean benchmarked by Xerox. 28. 30-31 
local ownership crucial lor success ol a quality improvement 
process. (>l 

longitudinal data questions 

to ask in anahsis of influence of external variables. 80-81 



M 

Malcolm Baldrige National Quality Award 

Pilot Study at Northwest Missouri Stale I'niversity. 38 
use as a template for continuous quality improvement. 38 
Masses and Meyerson < 199-t ) 

output benchmarking for gift processing performance. 8 
maximum effectiveness of benchmarking 

when supported bv senior level administrators and 
conducted by department units that will use* data. 09 
MUNQA. See Malcolm baldrige National Quality Award 
Merck (l-dwin I.) on value of benchmarking at Wheaton College. 92 
metrics 

critical that benchmarking partner use the same. 90 
Miami l niv ersitv of < )hio 

comparing effectiveness of student achievements with stall* 
l niversiiv of New York at I redonia. 31 
Michigan Stale I'niversity. 92 

(3. MAC Kill benchmarking Project results at. »3 
Michigan Technological I'niversitv. 3o 
Microsoft T'xcel spieadsheel 
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benchmarking software ptov idecl on. H(i 
mission stak-ment of the organization 

as a good place U) identify candidates for benchmarking. 
(C-OS 

modeling against certain standards to produce a desired result 
as a definition of benchmarking. \i 
Motorola l nt\ersii\ 

olten d< >es a better job ol assessing the* training and 
educatii >n 

needs ol their people than higher education does. i.S 



N 

NACl BO. See National Association of College and Cniversity 
Business ( )liicer> 

National Association of (.College and Cniversity Business Officers 
Benchmarking Process for Improvement in Higher 
llducation. 102 

Benchmarking Project intended to nit costs rather than 
justify nu ire d< dlars. 1 1 

National Benchmarking Sur\ e\ functional areas. 6" 

Project, SP- t.s 
study . 20 

National Conference on Continuous (Quality. i 

National Cooperate e Data share - Benchmark Data kxchange. 

18. ini 

subscription serv ice function. tS- tP 
National Institute of Standards and Technology Baldrige office. IS 
negative pertormancc gap definition. “S 
New Course Cancellation Kates. 1 P-S 0 

"new paradigm" requires building efficiency into the basic structure 
of the* organization. Pi 

noncredil programs of continuing education ofhecs benc hmark. *f> 
North Carolina State l diversity on list to benchmark. SI 
Northwest Missouri state l niversitv. Ss 

pips | clucalion Pilot award criteria at. in 

most thorough institutional bene hmarking application in 

higher education. Sp 



O 

( )klahoma state l niversitv on list of l diversities to benchmark. SI 
operational benchmarking. Set w//m> lime t tonal benchmarking 
linn in *mng ol. tv.h 

v alue o|. \ l 
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( >rcg< m State 1 nivcrsity 

inMitution.il [Pioneer in applying total quality nuiUi>oiKni. 9 
president ol university identified principal customers and 
•services to he provided to each customer group. (>9 
i|uestions to he asked w hen vontacting another 
organization. ~5 

state-mandated improvements involving benchmarking at. 

ol-n2 

study oh 51-52 

organizational weaknesses exposure minimized in benchmarking. 
5S 

original research as a source lor benchmarking data, "t 
outcomes 

majority of process improvements involve one or more. «S 2- 
S5 

outcome assessment through henchmarking. on 
"out of the hex" henchmarking as an opportunity to think. 10 
output henchmarking example for gift processing performance. ”K 
outright copying of a business process 

without analysis for organizational fit can cause problems. 



Pareto Principle 

20 percent of all activity affects So percent of the results, (>5 
parity performative gap definition. ~5 
PDCA. See Plan-l)o-(2hcck-Act 

Pedersen ( 1992) c|iieslioned applicability of all recent quality 
improvement lechnioues to higher education. 50 
Pennsylvania State l niversity benchmarking. SVS i 
performance gaps tvpes description and consequences. ~5-~o 
performance indicators 

as a topk in effieieney and public accountability. “ 
vliffercnce from benchmarking. 19 
performance standards not the same as henv hmarking. 19 
Pica flock 1 5 

plagiarism anvl industrial espionage avoivl.mv e. 5~ 

Plan-1 )o-Chcck Ae i approach. 21 
planning 

as fust Mv p in Ivin hmarking. 22 
the hciu hmarking sludv. 25 
positive pcrlormancc gap vlefimtion. “5 ~<> 
post industrial souciv as an inlormation soviet v . 1-2 
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post -secondary level of 'education as focus of quality improvement. 

I’ ^ R See Hriority-C^uality Product ivity 

"practical benchmarking. " Sec operational benchmarking 

Principle of Completion. 99 

Principle ol Confidentiality. 98 

Principle of Kxchange, 98 

Principle of Pirst-Party Contact. 98 

Principle of Legality. 9" 

Principle of Preparation, 99 
Principle of Third-Party Contact, 98-99 
Principle of Cnderslanding and Action. 99 
Principle of ( se. 98 
Priority-Quality- -Productivity. 91 
process enablers 

fourth step in benchmark process. 11 
key to improving performance, 11 
need to identify. 81 

suggested creation ol an action plan for implementation. 83 
process "owner" function. 83-8 1 
pr< iductiv it v 

lis a topic in efficiency and public accountability. ~ 
benchmarking a> a means to measure, t 
primary rational constraint on improvement is lack of 
availability for related data. S 
product process improvement outcomes definition. 83 
public domain information as sourer for benchmarking data, “"■i 
Public l 'nivvrsity Data Sharing Consortium. 18 

Q 

(jualily efforts results. “ 

quality movement in higher education reviewed in publications, s 
Qualitv learn Manual on Benchmarking 

seven points to consider before benchmarking. 93 
Queensland I nivcTsity of Technology benchmarking study . s’ 

K 

Katins lor Success," |9 

tec v cling or recalibration necessary lor benchmarking process to be 
lully elledive. 83 
reengineering 

is the- natural result ol benc hmarking. 3- 
imt proper tool tor minor adjustments. 




K-im on how Ix-nchmarking can help. M) 

Keillv. Sister Patricia Ann. \iit 

research to gather data as second step in benchmarking. 22 
Rhoades t IWit 

disad\ unlade of building upon existing organizational 
structures. S-b 

Rio Salado Community College 

receives Pioneer Award from Arizona Quality Alliance. K> 

Rudolph ( N ) 

college facultv suspicious ol efficiency and expert at 
obstruction. 

Rush t lwn 

administrative areas tor operatioii.il bene hmat king, s i 
basic criterion of generic benchmarking is w ho performs 
this activ ity best. S2 



S 

Schnell < I9 l ^> 

benchmarking used successtulh to reduce the pioccssing 
time for surplus property requests, vs-so 
SCX V. See Society for College and l niversity Planning 
selected admission benchmarks lor different institutional txpes, tl 

Sergios anni < ldhs ) 

school administrators adapt e\ery latest management fad. 2 
Sherr and Lozier 1 1WI > support of 1QM. <s 
shew art Cycle PDCA approach. 21 
Sill i lW) 

use of benchmarking by Illinois Hoard ol Higher education 
for purposes outside* its definition. hO-hl 
Sir Sanford Tleming College use ol benchmarking. So-S 
Sixty College Study. W 
SMAR T acronym m benchmarking, hh 
Societv for College and Itmersity Planning. 102-KH 
Southern l niversity data Sinning Consortium. ■»* 

Spendolini t IW2 > 

actions that should be taken during final stage of first 
benchmarking iteration. S1-S2 

benchmarking as an opportunity to think out ol the box. 

fn 

questions asked employees to help guide benchmarking 
teams, no 

suggested qualifications lor benchmarking team membets 
of. 
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summarizes what benelmurking is amt is not. 25 
Stark < I Wi 

tiit*lu-st interest in benchmarking of. ON-OS) 
no correlation between what \.\Cl H did and true 
benchmarking. »5 

stau* l niv cisjty of New Wk <M \Y> at hvdonia 

piv benchmarking comparativ c study in earlv- Idrto's. 5o-5I 
used he ik hnurk data to improve procurement practice 4 * in 
the purchasing office. t2 
Metar. I >r. Joseph. \iii 
StmtcfiW Hoicbnuirhin^. 55. on 
strategic benchmarking 
definition, no 
lunciioning. 55 

issues that tan he addressed l>v. no 

should he dosek linked to the strate.ua planning pioeevs. 

ni 

strate.ua Manning Institute l.ouneil on Benchmarking. l >~ 
straw objections” to benchmarking. 5" 

student IVriorniam e Kesults of Haklrige Award definition, no 
study of Independent Higher lahaation in Indiana. t.S 
Sun I It altli Alliante and the l ni\er**il\ Hospital Consortium 
hem hmarking used lot improving clinical (juaiiiv. 12 

T 

I Ml See The heme hmarking I Ac liange 
technical education delivery svstems 

heia hmarking as a method for improving voealioii.il 
leehna al 
education. I i 
“tec h prep ' 

an organizational alternative to traditional secondary sehool 
college prep and general education program. I t 
consortia in Vri/ona establishing nieliies to henchmaik a 
siaievv ide sv stem. I i 
lex. is Instruments benchmarking 12 
I he Hem hinai king I \< hange. 1 05 
set a u es of. ^2 

ihe best hrauue Cluh |omed with Ilk- Mem hmarking I'm lunge 

to i reate a global hem lima iking comm tin nation netwoik. 

- > 

//>e t>f / , (isf-/n<in'Hntil s<. t /e/i. I 

Iota! (jualitv Management. 2 
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decreasing use m Boston area colleges. ” 

.m<l bcm hmatkmg uimpaihon of pnpularitv. 0 -“ 

l( v )\l 

Vc<//.m* lot.tl k>u.ih(\ Management 

how < l t r'/h 

mnu’Niy management procedures become more 
dependent on c|u.mtified data for assessment of costs and 
benefits. XX 

l! 

I It iv h bene hmaikmg stuck () | human resources practice. 13-1 \ 
mmets.il higher education requires quantified data for 
assessment of costs and benefits. XX 
l imeisiu of Central Honda 

practices benchmarked with other organizations. S 3 
l imetsitN of 1 hu a t yo ( iiatluate School ol Business. S~. SS 
I iiiW'tMiv <»l Delaware 

miental benchmarking like studv. So 

k »nal Stuck ol Institutional Costs and Productivity. tX 

l imei'sitv n| Hawaii bench maik mu software used at. X“-XX 
t tu\etsii\ « i| Mar\ land 

lietti. hmarkmg used suceesslullv to reduce the processing 
tune for surplus property requests. SS-S(> 

\ imetsit\ o| \hami use- ol key success indices. o9-“u 
I imetsiK ol Mk hitman bene hmarking study 

of human resources competencies and practice. 1 3*1 1 
I imersit\ ol Minnesota (3 MAC l* MI Benchmarking Project 

identified significant internal problems and indicated 
appropriate ac lion. |S 
t mv eisit\ < )| i )ivi»< mi 

compared with Oregon Stale 1'imersitv. (»J 
highest interest m benchmarking at. t>‘) 
on list ol t imersjties to benchmark. SI 
I im ei site < if W 1 sc i misiu 

lometl I Ik- Benchmarking l‘\changc to obtain partners. 

“I ~2 

t in\i isit\ s\ stoin of ( leorgia description of 

o.gam/alional striktuies and administraii\ e practices. S| 

I psala ( ullege in New Jersey . 3 
I s Depaitment of Kluc ai ion Web Server. I ( >3 
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Veysey ( 1968) 

huge changes in American universities from 1860 to 1900, 1 
vision to "iountl an institution where any person can find 
instruction in any study" no longer possible. 90 



W 

Washington State I'niversity on list to benchmark. SI 
Watson < 1992) 

questionnaire proposed lor use in a study ol original 
reseal ch. ""-t 

questions when contacting another organization, -t- 8 
suggested creation of an action plan for implementing each 
individual process enabler. S3 
Watson ( 1993). 22 

definition of strategic benchmarking by. 90 
focus of improvement ellorts should be on processes that 
haw highest potential for "return on attention, 68 
how strategic benchmarking differs horn operational 
benchmarking. 33 

recommended questions to clarily results ot data analysis. 
S0-S1 

Watson 1 1998) on how competitive benchmarking 
ditlers from process benchmarking. 29-30 
Westinghouse benchmarking. 12 
West Virginia 1 'Diversity. 36 

W heaton (.ollege in .Massachusetts used bent hm.it king data 

to ensure that TQM and Business Process Reengineering 
cfl oris address areas with greatest potential lor 
improvement. t2 
with TQM and BPR. 92 
W'oherlon ( 199 1 ) 

benchmarking is only based upon current information. 38 
world class benchmarking 

only suitable for already high-perlorming organizations. n3 



X 

Xerox company hem hmarking. 10. 12. 23. -8. 30-31 




/J«S* 



138 




ASHE ERIC HIGHER EDUCATION REPORTS 

Sinc e lvK-i. the Association for the Study of Higher Etluea- 
tion (ASH I:) and the Educational Resources Information 
Center (HRIO Cdearinghou.se on Higher Education, a spon- 
sored project of the Graduate School of Education and 
Human Development at The George Washington University, 
have cosponsored the AS1 IE- ERIC Higher Education Report 
series. The 1995 series is the twenty-fourth overall and the 
seventh to he published by the Graduate School ot 
Education and Human Development at The George 
Washington University. 

Each monograph is the definitive analysis of a lough 
higher education problem, based on thorough research ot 
pertinent literature and institutional experiences. Topics are 
identified by a national survey. Noted practitioners and 
scholars are then commissioned to write the reports, with 
experts providing critical reviews ol each manuscript before 
publication. 

Eight monographs ( 10 belore 1985) in the ASHE-ER1C 
Higher Education Report series are published each year and 
are available on individual and subscription bases. Io order, 
use the order lorm on the last page o! this book. 

Qualified persons interested in writing a monograph for 
die AS1 IE-ER1C Higher Education Report series are invited to 
submit a proposal to the National Advisory Board. As the 
preeminent literature review and issue analysis series in 
higher education, the Higher Education Reports are guaran- 
teed wide dissemination and national exposure lor accepted 
candidates. Execution of a monograph requires at least a 
minimal familiarity with the ERIC database, including 
Resources in Education and the Current Index to Journals in 
Education. The objective of these reports is to bridge con- 
ventional wisdom with practical research. Prospective authois 
are strongly encouraged to call Dr. fife at 800- ’3-3 *2. 

For further information, write to 

ASHE-ER1C Higher Education Reports 
The George Washington University 
One Dupont Circle. Suite (>30 
Washington. DC 20030 

Or phone (202) 29(>-259~; toll live: 800- 3T.RIC. 

Write or call for a complete catalog. 
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1995 ASHE-ERIC Higher Education Reports 

l. Tenure. Promotion, and Reappointment: Legal and 
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